-- Logs begin at Mon 2021-04-19 02:53:31 UTC, end at Mon 2021-04-19 04:21:48 UTC. -- Apr 19 03:29:23.469185 dv-cinder-786054-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 19 03:29:23.476883 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: *** Starting uWSGI 2.0.15-debian (64bit) on [Mon Apr 19 03:29:23 2021] *** Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: nodename: dv-cinder-786054-3-iscsi Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: machine: x86_64 Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: clock source: unix Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: pcre jit disabled Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: detected number of CPU cores: 4 Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: current working directory: / Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: detected binary path: /usr/bin/uwsgi-core Apr 19 03:29:23.478836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: dropping root privileges as early as possible Apr 19 03:29:23.479803 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: your processes number limit is 47843 Apr 19 03:29:23.479803 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: your memory page size is 4096 bytes Apr 19 03:29:23.479803 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: detected max file descriptor number: 2048 Apr 19 03:29:23.479803 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: lock engine: pthread robust mutexes Apr 19 03:29:23.479803 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: thunder lock: enabled Apr 19 03:29:23.479803 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 19 03:29:23.479803 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: dropping root privileges after socket binding Apr 19 03:29:23.479803 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 19 03:29:23.524612 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: Python main interpreter initialized at 0x5559c00be9c0 Apr 19 03:29:23.524612 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: dropping root privileges after plugin initialization Apr 19 03:29:23.524612 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: python threads support enabled Apr 19 03:29:23.524612 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: your server socket listen backlog is limited to 100 connections Apr 19 03:29:23.524612 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: your mercy for graceful operations on workers is 90 seconds Apr 19 03:29:23.525071 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: mapped 402621 bytes (393 KB) for 2 cores Apr 19 03:29:23.525071 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: *** Operational MODE: preforking *** Apr 19 03:29:23.525241 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: dropping root privileges after application loading Apr 19 03:29:23.525241 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: *** uWSGI is running in multiple interpreter mode *** Apr 19 03:29:23.525241 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: spawned uWSGI master process (pid: 85743) Apr 19 03:29:23.525388 dv-cinder-786054-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 19 03:29:23.525755 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: spawned uWSGI worker 1 (pid: 85744, cores: 1) Apr 19 03:29:23.526053 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: spawned uWSGI worker 2 (pid: 85745, cores: 1) Apr 19 03:29:23.526211 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 19 03:29:28.495464 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 19 03:29:28.495999 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 19 03:29:28.497309 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 19 03:29:28.497743 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 19 03:29:28.498033 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 19 03:29:28.498493 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.498859 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.499268 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.499655 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.500034 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.500383 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.500749 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.500859 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 19 03:29:28.501094 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 19 03:29:28.501207 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.501459 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.501753 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.502111 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.502480 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786054-3-iscsi {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.502664 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 19 03:29:28.502845 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.503095 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 19 03:29:28.503218 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.503418 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 19 03:29:28.503519 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.503871 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.503971 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.504215 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.504314 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.504573 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.504681 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.504909 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.505008 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.505297 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.505529 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.505638 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.505876 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.505981 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.506219 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.506323 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.506567 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.506673 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.506939 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.507043 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.507325 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.507427 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.507669 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.507779 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786054-3-iscsi {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.508033 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.508138 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.508375 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.508482 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.508729 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.508833 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.509069 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.509167 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.509413 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.509516 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786054-3-iscsi {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.509763 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.509862 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.510110 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.510229 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.510453 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.510733 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.510942 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.511085 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.511327 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.511434 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.511674 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.511781 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.512041 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.512139 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.512407 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.512523 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.512755 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.512877 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.513129 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.513227 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.513475 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.513581 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.513833 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.513939 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.514180 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.514277 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.514516 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.514690 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786054-3-iscsi {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.514862 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.514969 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.515738 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.515847 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.516100 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.516200 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.516437 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.516593 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.516775 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.516949 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.517053 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.517304 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.517410 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.517674 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.517780 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.518045 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.518145 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.518397 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.518496 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.518676 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.518782 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.518960 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.519125 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.519350 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.519517 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.519717 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.519889 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.520069 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.520240 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.520415 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.520591 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.520757 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.520942 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.521102 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.521311 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.521448 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.521659 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.521764 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.522007 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.522114 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.522314 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.522466 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.522648 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.522754 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.523019 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.523129 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.523415 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.523518 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.523794 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.523895 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.524088 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.524189 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.524380 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.524570 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.524749 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.524848 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.525122 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.525230 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.525484 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.525589 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.525837 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.525937 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.526180 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.526280 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.526522 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.526622 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.526872 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.526978 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.527231 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.527346 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.527575 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.527675 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.527911 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.528018 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.528272 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.528372 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.528627 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.528727 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.528962 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.529070 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.529245 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.529345 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.529582 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.529681 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.529924 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.530093 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.530307 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.530454 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.530627 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.530726 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.531547 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.531656 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.531891 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.531991 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.532229 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.532328 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.532572 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.532673 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.538969 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.539103 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.539255 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.539355 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.539466 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.539572 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.539669 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.539764 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.539865 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.539966 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540070 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540166 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540266 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540361 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540461 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540540 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540620 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540715 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540810 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540904 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.540998 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.541103 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.541200 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.541300 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.541401 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.541496 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.541590 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.541692 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.541794 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.541889 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.541983 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.542077 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.542170 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.542271 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.542366 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.542466 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.542561 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.542690 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.542789 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.542895 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.542992 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.543119 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.543262 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.543360 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.543455 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.543561 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.543657 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.543756 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.543857 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.543952 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.544057 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.544153 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.544253 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.544355 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.544451 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.544550 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.544652 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.544747 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.544848 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.544948 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545021 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545089 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545188 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545283 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545376 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545469 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545563 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545657 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545758 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545854 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.545947 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.546080 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.546191 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.546320 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.546434 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.546540 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.546654 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.546762 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.546873 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.546987 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.547096 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.547237 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.547354 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.547468 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.547582 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.547710 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.548043 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.548155 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.548262 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.548367 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.548481 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.548597 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.548713 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.548830 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.548830 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.549033 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.549148 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.549264 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.549373 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.549479 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.549590 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.549703 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.549823 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.549965 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.550086 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.550198 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.550313 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.550465 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.550613 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.550750 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.550893 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.551030 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.551218 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.551359 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.551507 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:29:28.551716 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.551866 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.552072 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.552213 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.552429 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.552576 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.552785 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.552928 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.553134 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.553281 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.553487 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.553628 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.553856 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.553998 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.554214 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.554354 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.554564 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.554711 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.554933 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.555074 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.555323 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.555551 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.555697 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.555834 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.555970 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.556108 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.556313 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.556455 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.556669 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.556810 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.557024 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.557174 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.557373 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.557515 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.557721 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.557869 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.558073 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.558225 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.558416 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.558562 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.558766 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.558912 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.559131 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.559308 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.559505 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.559646 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.559857 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.559998 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.560204 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.560354 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.560549 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.560703 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.560893 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.561042 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.561241 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.561384 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.561590 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.561736 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.561949 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.562091 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.562331 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.562473 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.562668 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.562815 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.563019 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.563217 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.563396 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.563536 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.563746 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.563886 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.564088 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.564230 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.564431 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.564578 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.564779 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.564920 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.565128 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.565270 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.565470 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.565612 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.565813 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.565961 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.566155 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.566296 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.566498 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.566640 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.566840 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.566992 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.567198 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.567343 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.567542 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.567684 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.567894 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.568050 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.568243 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.568387 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.568590 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.568731 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.568938 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.569086 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.569311 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.569464 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.569607 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.569745 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.569943 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.570092 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.570290 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.570430 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.570640 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.570781 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.571021 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.571183 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.571324 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.571460 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.571686 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.571829 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.572035 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.572176 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.572376 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.572525 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.572718 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.572866 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.573059 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.573201 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.573402 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.573543 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.573745 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.573887 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.574084 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.574225 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.574422 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.574562 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.574764 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.574912 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.575105 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.575275 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.575472 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.575620 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.575813 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.575967 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.576178 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.576319 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.576518 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.576659 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.576858 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.577010 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.577198 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.577339 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.577537 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.578184 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.578414 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.578563 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.578763 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.578904 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.579115 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.579288 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.579486 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.579692 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.579837 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.579985 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.580159 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.580307 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.580503 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.580644 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.580841 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.580987 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.581177 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.581324 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.581516 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.581658 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.581879 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.582020 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.582222 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.582364 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.582562 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.582709 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.582898 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.583038 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.583239 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.583393 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.583641 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.583784 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.583995 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.584135 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.584336 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.584477 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.584685 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.584827 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.585048 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.585189 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.585398 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.585547 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.585745 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.585885 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.586093 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.586234 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.586428 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.586582 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.586770 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.586921 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.587118 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.587290 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.587484 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.587634 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.587823 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.587964 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.588165 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.588313 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.588498 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.588652 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.588851 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.588997 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.589197 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.589343 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.589541 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.589690 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.589880 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.590021 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.590227 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.590368 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.590573 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.590719 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.590914 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.591056 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.591285 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.591427 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.591635 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.591779 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.591975 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.592115 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.592318 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.592459 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.592669 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.592812 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.593009 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.593151 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.593907 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.594054 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.594237 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.594386 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.594579 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.594721 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.594936 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.595085 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.595279 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.595429 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.595633 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.595774 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.595985 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.596137 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.596340 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.596488 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.596663 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.596804 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.597015 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.597168 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.597365 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.597505 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.597704 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.597850 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.598052 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.598200 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.598406 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.598547 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.598750 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.598891 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.599090 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.599264 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.599459 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.599577 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.599800 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.599918 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.600147 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.600296 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.600513 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.600661 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.600853 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.600971 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.601193 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.601335 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.601563 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.601720 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.601860 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.601970 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.602210 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.602358 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.602896 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.602994 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.603098 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.603219 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.603317 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.603578 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.603679 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.603933 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.604091 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.604281 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.604381 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.604632 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.604732 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.604977 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.605084 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.605333 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.605434 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.605695 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.605795 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.606047 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.606157 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.606392 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.606494 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.606735 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.606835 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.607358 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.607467 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.607715 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.607823 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.608068 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.608167 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.608412 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.608760 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.608892 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.609140 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.609240 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.609491 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.609600 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.609836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.609936 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.610183 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.610283 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.610528 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.610636 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.610872 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.610972 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.611250 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.611356 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.611595 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.611708 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.611940 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.612040 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.612277 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.612377 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.612619 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.612722 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.612967 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.613074 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.613309 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.613409 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.613650 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.613757 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.613984 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.614085 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.614323 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.614426 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.614676 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.614777 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.615024 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.615181 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.615398 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.615499 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.615746 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.615892 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.616101 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.616201 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.616437 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.616548 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.616780 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.616881 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.617122 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.617225 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.617460 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.617568 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.617806 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.617907 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.618151 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.618251 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.618491 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.618599 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.618832 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.618938 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.619183 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.619287 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.619532 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.619641 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.619872 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.619978 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.620216 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.620316 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.620555 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.620663 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.620908 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.621014 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.621248 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.621348 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.621586 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.621686 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.621930 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.622029 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.622276 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.622377 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.622621 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.622727 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.622960 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.623059 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.623349 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.623452 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.623691 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.623792 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.624030 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.624130 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.624377 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.625015 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.625234 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.625348 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.625574 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.625684 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.625920 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.626044 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.626265 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.626366 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.626618 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.626736 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.626955 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.627069 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.627340 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.627451 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.627681 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.627782 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.628016 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.628124 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.628357 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.628458 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.628697 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.628798 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.629029 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.629137 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.629368 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.629474 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.629707 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.629807 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.630049 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.630162 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.630387 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.630495 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.630738 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.630837 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.631076 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.631206 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.631444 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.631545 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.631784 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.631890 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.632124 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.632225 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.632471 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.632572 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.632821 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.632922 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.633172 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.633273 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.633521 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.633622 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.633868 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.633968 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.634208 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.634315 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.634554 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.634667 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.634890 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.634998 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.635260 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.635365 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.635605 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.635706 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.635949 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.636111 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.636292 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.636393 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.636634 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.636754 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.636974 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.637093 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.637319 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.637435 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.637664 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.637771 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.638022 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.638138 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.638388 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.638497 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.638756 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.638870 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.639089 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.639245 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.639464 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.639583 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.639813 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.639922 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.640202 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.640800 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.641054 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.641164 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.641409 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.641517 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.641767 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.641883 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.642114 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.642227 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.642454 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.642561 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.642797 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.642905 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.643164 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.643273 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.643517 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.643618 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.643859 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.643959 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.644206 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.644304 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.644572 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.644743 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.644897 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.644999 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.645240 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.645341 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.645583 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.645751 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.645930 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.646036 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.646267 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.646370 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.646614 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.646737 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.646957 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.647068 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.647326 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.647472 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.647681 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.647826 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.648035 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.648174 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.648389 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.648490 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.648741 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.648850 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.649097 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.649204 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.649451 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.649552 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.649799 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.649906 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.650136 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.650237 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.650497 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.650597 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.650846 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.650946 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.651221 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.651325 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.651571 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.651672 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.651915 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.652016 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.652255 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.652361 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.652602 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.652753 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.652969 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.653109 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.653314 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.653464 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.653654 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.653814 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.653996 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.654169 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.654362 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.654526 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.654765 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.654885 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.655058 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.655241 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.655569 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.655771 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.655943 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.656060 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.656288 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.656393 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.656745 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.656845 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.657091 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.657211 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.657430 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.657531 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.657779 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.657879 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.658135 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.658242 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.658497 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.658597 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.658840 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.658940 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.659207 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.659311 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.659552 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.659663 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.659917 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.660017 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.660270 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.660370 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.660611 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.660717 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.660966 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.661103 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.661309 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.661462 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.661678 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.661785 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.662044 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.662268 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.662377 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.662632 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.662731 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.662993 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.663202 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.663398 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.663575 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.663776 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.663924 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.664153 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.664290 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.664508 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.664661 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.664869 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.664983 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.665205 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.665306 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.665581 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.665682 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.665954 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.666054 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.666300 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.666448 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.666658 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.666759 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.666993 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.667107 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.667371 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.667490 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.667718 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.667826 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.668066 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.668170 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.668407 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.668519 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.668751 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.668852 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.669114 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.669220 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.669457 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.669569 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.669822 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.669928 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.670173 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.670280 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.670539 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.670647 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.670895 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.670995 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.671256 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.671388 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.671631 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.671740 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.671980 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.672080 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.672325 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.672431 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.672669 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.672779 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.673002 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.673102 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.673354 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.673454 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.673708 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.673809 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.674050 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.674150 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.674401 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.674507 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.674766 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.674872 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.675110 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.675264 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.675503 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.675604 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.675866 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.675973 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.676213 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.676312 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.676573 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.676679 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.676917 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.677018 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.677257 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.677376 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.677601 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.677721 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.677942 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.678042 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.678276 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.678381 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.678618 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.678785 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.678953 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.679054 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.679323 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.679426 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.679664 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.679780 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.680004 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.680106 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.680345 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.680446 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.680710 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.680840 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.681054 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.681155 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.681418 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.681525 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.681766 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.681867 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.682106 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.682207 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.682450 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.682555 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.682790 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.682890 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.683130 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.683298 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.683508 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.683609 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.683858 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.683958 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.684209 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.684311 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.684558 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.684659 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.684915 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.685053 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.685259 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.685368 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.685598 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.685699 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.685946 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.686110 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.686294 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.686395 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.686643 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.686751 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.687513 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.687636 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.687873 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.687995 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.688213 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.688314 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.688562 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.688663 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.688901 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.689030 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.689250 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.689351 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.689605 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.689707 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.689961 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.690061 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.690322 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.690549 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.690695 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.690916 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.691070 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.691295 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.691453 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.691647 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.691830 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.691999 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.692192 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.692356 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.692554 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.692705 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.692915 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.693062 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.693275 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.693382 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.693637 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.693744 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.693996 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.694097 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.694357 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.694463 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.694711 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.694820 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.695071 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.695191 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.695457 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.695568 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.695805 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.695907 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.696162 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.696410 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.696519 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.696778 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.696902 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.697139 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.697241 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.697499 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.697600 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.697872 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.698021 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.698210 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.698313 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.698559 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.698660 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.698911 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.699013 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.699285 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.699402 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.699633 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.699735 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.699982 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.700083 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.700333 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.700433 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.700686 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.700787 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.701034 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.701135 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.701384 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.701492 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.701737 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.701845 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.702097 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.702197 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.702461 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.702562 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.703405 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.703525 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.703752 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.703854 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.704108 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.704208 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.704461 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.704562 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.704834 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.705043 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.705205 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.705427 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.705551 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.705755 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.705910 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.706124 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.706273 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.706495 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.706603 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.706852 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.706991 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.707227 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.707342 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.707602 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.707715 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.707947 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.708063 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.708292 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.708408 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.708641 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.708742 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.708988 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.709088 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.709331 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.709442 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.709696 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.709796 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.710045 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.710144 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.710389 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.710488 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.710748 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.710975 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.711074 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.711360 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.711705 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.711817 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.712102 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.712202 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.712450 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.712549 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.712812 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.712918 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.713175 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.713275 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.713536 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.713635 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.713879 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.713984 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.714232 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.714331 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.714570 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.714670 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.714915 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.715025 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.715282 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.715399 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.715651 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.715762 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.715993 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.716115 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.716335 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.716435 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.716680 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.716785 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.717030 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.717130 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.717375 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.717633 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.717739 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.718038 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.718157 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.718422 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.718534 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.718766 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.718865 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.719109 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.719221 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.719478 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.719588 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.719828 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.719927 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.720163 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.720269 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.720505 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.720604 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.720849 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.720948 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.721191 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.721290 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.721538 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.721642 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.721873 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.721971 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.722213 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.722318 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.722547 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.722645 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.722896 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.722995 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.723256 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.723391 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.723608 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.723708 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.723943 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.724042 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.724307 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.724412 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.724642 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.724742 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.724985 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.725083 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.725335 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.725441 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.725681 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.725808 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.726022 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.726146 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.726372 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.726488 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.726712 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.726822 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.727058 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.727197 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.727443 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.727544 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.727793 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.728037 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.728146 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.728416 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.728574 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.728775 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.728931 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.729115 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.729263 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.729469 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.729612 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.729815 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.729976 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.730156 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.730330 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.730492 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.730647 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.730808 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.730954 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.731182 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.731343 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.731531 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.731680 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.731874 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.732042 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.732502 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.732661 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.732827 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.732996 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.733143 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.733291 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.733500 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.733661 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.733860 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.734163 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.734313 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.734538 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.734715 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.734900 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.735048 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.735303 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.735409 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.735660 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.735785 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.736014 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.736130 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.736357 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.736459 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.736697 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.736803 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.737043 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.737142 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.737389 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.737500 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.737733 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.737840 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.738083 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.738182 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.738439 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.738545 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.738783 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.738883 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.739128 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.739274 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.739502 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.739629 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.739859 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.739967 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.740214 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.740319 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.740569 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.740670 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.740934 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.741033 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.741301 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.741401 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.741667 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.741768 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.742031 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.742140 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.742392 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.742491 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.742731 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.742838 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.743077 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.743206 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.743452 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.743551 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.743803 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.743910 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.744156 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.744255 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.744539 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.744640 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.744887 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.744994 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.745230 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.745330 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.745638 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.745749 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.745946 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.746112 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.746295 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.746395 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.746643 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.746746 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.746991 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.747096 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.747367 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.747468 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.747724 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.747823 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.748080 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.748180 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.748437 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.748580 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.748785 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.748894 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.749138 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.749238 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.749969 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.750099 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.750336 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.750437 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.750680 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.750786 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.751033 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.751133 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.751408 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.751515 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.751761 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.751866 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.752138 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.752238 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.752485 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.752592 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.752833 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.752932 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.753175 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.753275 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.753522 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.753777 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.753886 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.753982 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.754208 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.754315 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.754563 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.754670 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.754911 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.755011 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.755282 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.755387 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.755651 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.755762 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.755997 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.756099 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.756340 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.756440 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.756682 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.756782 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.757021 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.757121 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.757370 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.757520 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.757718 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.757825 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.758087 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.758187 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.758438 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.758538 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.758775 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.758878 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.759160 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.759263 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.759516 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.759627 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.759876 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.759975 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.760232 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.760343 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.760579 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.760686 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.760934 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.761040 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.761275 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.761374 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.761629 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.761797 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.761977 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.762084 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.762324 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.762424 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.762671 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.762782 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.763020 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.763120 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.763404 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.763515 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.763762 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.763870 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.764123 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.764222 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.764492 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.764592 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.764844 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.764944 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.765764 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.765873 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.766131 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.766239 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.766500 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.766615 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.766772 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85744) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 19 03:29:28.766874 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.767226 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.767615 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.767974 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.768338 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.768693 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.769050 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.769412 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.769775 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.770150 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.770530 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.770902 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.771320 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.771721 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.772081 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.772954 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.773346 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:29:28.773631 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85745) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 19 03:29:28.802531 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85744) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:29:28.807874 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85745) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:29:29.140849 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.context [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb(cell1) {{(pid=85744) load_cells /opt/stack/nova/nova/context.py:466}} Apr 19 03:29:29.146225 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85744) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:29:29.148206 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85744) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:29:29.149070 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85744) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:29:29.150039 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.context [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb(cell1) {{(pid=85745) load_cells /opt/stack/nova/nova/context.py:466}} Apr 19 03:29:29.151172 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85744) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:29:29.155517 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:29:29.157542 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:29:29.158423 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:29:29.160601 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:29:29.177368 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85744) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:29:29.178540 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85744) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:29:29.184988 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85745) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:29:29.192428 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85745) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:29:29.209100 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85744) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:29:29.218715 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85745) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:29:29.344735 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 19 03:29:29.344735 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: from cryptography.utils import int_from_bytes Apr 19 03:29:29.345158 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 19 03:29:29.345158 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: from cryptography.utils import int_from_bytes Apr 19 03:29:29.356969 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 19 03:29:29.356969 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: from cryptography.utils import int_from_bytes Apr 19 03:29:29.357613 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 19 03:29:29.357613 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: from cryptography.utils import int_from_bytes Apr 19 03:29:29.422960 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Loading Gnome Apr 19 03:29:29.435445 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Loading Gnome Apr 19 03:29:29.443535 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Loading Google Apr 19 03:29:29.446926 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Loading Windows (alt) Apr 19 03:29:29.451505 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Loading file Apr 19 03:29:29.452604 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Loading keyczar Apr 19 03:29:29.453056 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Loading multi Apr 19 03:29:29.453926 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Loading pyfs Apr 19 03:29:29.457502 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Loading Google Apr 19 03:29:29.460945 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Loading Windows (alt) Apr 19 03:29:29.465543 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Loading file Apr 19 03:29:29.466641 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Loading keyczar Apr 19 03:29:29.467100 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Loading multi Apr 19 03:29:29.467993 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO keyring.backend [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Loading pyfs Apr 19 03:29:29.735376 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: WARNING keystonemiddleware.auth_token [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 03:29:29.742542 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: WARNING keystonemiddleware.auth_token [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 03:29:29.750081 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: WARNING keystonemiddleware.auth_token [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 03:29:29.757307 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: WARNING keystonemiddleware.auth_token [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 03:29:30.074805 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: WARNING keystonemiddleware.auth_token [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 03:29:30.080515 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: WARNING keystonemiddleware.auth_token [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 03:29:30.086812 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5559c00be9c0 pid: 85744 (default app) Apr 19 03:29:30.089047 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:29:30.090225 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001788 Apr 19 03:29:30.090654 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 779 bytes} [Mon Apr 19 03:29:30 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:29:30.091284 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: WARNING keystonemiddleware.auth_token [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 03:29:30.097083 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: WARNING keystonemiddleware.auth_token [None req-4a403421-573e-471f-9c94-2fca147ab723 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 03:29:30.103526 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5559c00be9c0 pid: 85745 (default app) Apr 19 03:30:56.907573 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:30:56.908639 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Apr 19 03:30:56.909047 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:30:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:30:57.398862 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-147cffd9-ee49-4ff9-88e0-c3a16d8ef615 admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:30:57.427087 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-147cffd9-ee49-4ff9-88e0-c3a16d8ef615 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.510741 Apr 19 03:30:57.427887 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1281 bytes} [Mon Apr 19 03:30:56 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:30:59.919801 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:30:59.920856 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-ab0f2a96-33e1-4e05-b85a-01bb887372e0 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Apr 19 03:30:59.921266 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:30:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:30:59.986923 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-3e9cc524-2eab-414f-b2a6-1c6b8b7183b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256}} {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:00.012220 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:31:00.012220 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: warnings.warn(msg) Apr 19 03:31:00.067284 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-3e9cc524-2eab-414f-b2a6-1c6b8b7183b1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.139435 Apr 19 03:31:00.075916 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1272 bytes} [Mon Apr 19 03:30:59 2021] POST /compute/v2.1/flavors => generated 407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:31:00.315767 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-a528ceef-7809-4160-b8c4-bb3d4c6058ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:00.319598 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:31:00.319598 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: warnings.warn(msg) Apr 19 03:31:00.401787 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-a528ceef-7809-4160-b8c4-bb3d4c6058ce admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.324447 Apr 19 03:31:00.403098 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1325 bytes} [Mon Apr 19 03:31:00 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:31:02.903587 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-3e9cc524-2eab-414f-b2a6-1c6b8b7183b1 admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:02.905299 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-3e9cc524-2eab-414f-b2a6-1c6b8b7183b1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002221 Apr 19 03:31:02.905938 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:31:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:31:03.025999 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-3ae4b6d6-034a-4788-93b8-853c35c16296 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "swap": 0, "ram": 512, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:03.049589 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:31:03.049589 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: warnings.warn(msg) Apr 19 03:31:03.128999 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-3ae4b6d6-034a-4788-93b8-853c35c16296 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.216092 Apr 19 03:31:03.129644 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1272 bytes} [Mon Apr 19 03:31:02 2021] POST /compute/v2.1/flavors => generated 404 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:31:03.142949 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-86e9f0e2-19d3-442b-8b19-a7cd6d9f5394 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:03.144700 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:31:03.144700 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: warnings.warn(msg) Apr 19 03:31:03.241414 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-86e9f0e2-19d3-442b-8b19-a7cd6d9f5394 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102382 Apr 19 03:31:03.242186 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1325 bytes} [Mon Apr 19 03:31:03 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:31:05.768561 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-3ae4b6d6-034a-4788-93b8-853c35c16296 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:05.769642 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-3ae4b6d6-034a-4788-93b8-853c35c16296 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Apr 19 03:31:05.770078 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:31:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:31:05.834130 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-8bf93d4a-9d4d-49f4-b4ce-901387d883db admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "name": "ds1G", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:05.895465 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-8bf93d4a-9d4d-49f4-b4ce-901387d883db admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.118763 Apr 19 03:31:05.896402 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1272 bytes} [Mon Apr 19 03:31:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:31:05.909512 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-cb57979e-9822-48ad-9f5b-bf8b9ad5b070 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:06.032039 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-cb57979e-9822-48ad-9f5b-bf8b9ad5b070 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126679 Apr 19 03:31:06.032609 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1325 bytes} [Mon Apr 19 03:31:05 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:31:08.586247 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-8bf93d4a-9d4d-49f4-b4ce-901387d883db admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:08.587358 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-8bf93d4a-9d4d-49f4-b4ce-901387d883db admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Apr 19 03:31:08.588219 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:31:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:31:08.652428 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-c2f745dd-94b2-470f-9a1f-c7eff6c2afc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:08.704569 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-c2f745dd-94b2-470f-9a1f-c7eff6c2afc3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.109736 Apr 19 03:31:08.705141 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1272 bytes} [Mon Apr 19 03:31:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:31:08.717545 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-04e48a5d-50c2-4584-9655-d2f6e9a30c6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:08.780062 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-04e48a5d-50c2-4584-9655-d2f6e9a30c6c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066313 Apr 19 03:31:08.780572 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1325 bytes} [Mon Apr 19 03:31:08 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:31:11.271989 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-c2f745dd-94b2-470f-9a1f-c7eff6c2afc3 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:11.273726 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-c2f745dd-94b2-470f-9a1f-c7eff6c2afc3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002277 Apr 19 03:31:11.274144 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:31:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:31:11.342868 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-44863330-a743-4e71-96f0-d49b28cd8ccb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "ram": 4096}} {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:11.390698 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-44863330-a743-4e71-96f0-d49b28cd8ccb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.109486 Apr 19 03:31:11.391319 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1272 bytes} [Mon Apr 19 03:31:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:31:11.403908 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-72f85331-9cb2-4abf-ba9d-2aae057b006a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:11.460827 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-72f85331-9cb2-4abf-ba9d-2aae057b006a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060721 Apr 19 03:31:11.461531 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1325 bytes} [Mon Apr 19 03:31:11 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:31:13.969676 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-44863330-a743-4e71-96f0-d49b28cd8ccb admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:13.971072 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-44863330-a743-4e71-96f0-d49b28cd8ccb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Apr 19 03:31:13.971797 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:31:13 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:31:14.037085 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-a79418fb-17db-4659-9bce-8e99d3c17629 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:14.062615 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-a79418fb-17db-4659-9bce-8e99d3c17629 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082329 Apr 19 03:31:14.063332 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1281 bytes} [Mon Apr 19 03:31:13 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:31:16.542375 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-44863330-a743-4e71-96f0-d49b28cd8ccb admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:16.543871 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-44863330-a743-4e71-96f0-d49b28cd8ccb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Apr 19 03:31:16.544436 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:31:16 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:31:16.610768 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-d40bcf82-3a73-411e-be7b-5c8a7ae80cb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:16.657371 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-d40bcf82-3a73-411e-be7b-5c8a7ae80cb8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.105793 Apr 19 03:31:16.657971 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1272 bytes} [Mon Apr 19 03:31:16 2021] POST /compute/v2.1/flavors => generated 402 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:31:16.672194 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7980ca34-1853-4edf-a229-8bf9c3974959 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:16.740670 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7980ca34-1853-4edf-a229-8bf9c3974959 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073754 Apr 19 03:31:16.741246 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1322 bytes} [Mon Apr 19 03:31:16 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:31:19.209718 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-d40bcf82-3a73-411e-be7b-5c8a7ae80cb8 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:19.210808 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-d40bcf82-3a73-411e-be7b-5c8a7ae80cb8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Apr 19 03:31:19.211310 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:31:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:31:19.272360 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-32a571f8-b4bd-4efa-b6a3-a4268b563b25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "id": "2", "rxtx_factor": 1.0, "disk": 20, "vcpus": 1}} {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:19.328891 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-32a571f8-b4bd-4efa-b6a3-a4268b563b25 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.111217 Apr 19 03:31:19.329479 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1272 bytes} [Mon Apr 19 03:31:19 2021] POST /compute/v2.1/flavors => generated 405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:31:19.342280 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-f3b4a110-2b52-4c7b-8d75-43fea6d6a0ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:19.409943 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-f3b4a110-2b52-4c7b-8d75-43fea6d6a0ce admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071521 Apr 19 03:31:19.410493 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1322 bytes} [Mon Apr 19 03:31:19 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:31:21.941453 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-32a571f8-b4bd-4efa-b6a3-a4268b563b25 admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:21.942533 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-32a571f8-b4bd-4efa-b6a3-a4268b563b25 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Apr 19 03:31:21.942989 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:31:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:31:22.004591 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-4b0591c4-6dc6-48b0-8ec7-d185f0d2bd5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:22.053969 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-4b0591c4-6dc6-48b0-8ec7-d185f0d2bd5b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.104414 Apr 19 03:31:22.054498 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1272 bytes} [Mon Apr 19 03:31:21 2021] POST /compute/v2.1/flavors => generated 406 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:31:22.067189 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-941065cd-9b9b-4aeb-a224-421a67ea22bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:22.130397 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-941065cd-9b9b-4aeb-a224-421a67ea22bf admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067085 Apr 19 03:31:22.131022 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1322 bytes} [Mon Apr 19 03:31:22 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:31:24.646200 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-4b0591c4-6dc6-48b0-8ec7-d185f0d2bd5b admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:24.647302 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-4b0591c4-6dc6-48b0-8ec7-d185f0d2bd5b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Apr 19 03:31:24.647731 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:31:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:31:24.745101 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-29a01c85-4c7f-4923-9487-37c6a1bad270 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0, "disk": 80, "name": "m1.large", "ram": 8192}} {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:24.796752 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-29a01c85-4c7f-4923-9487-37c6a1bad270 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142047 Apr 19 03:31:24.797464 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1272 bytes} [Mon Apr 19 03:31:24 2021] POST /compute/v2.1/flavors => generated 405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:31:24.813237 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-e7eb33cd-8bbf-4142-8d61-d2e1c7b711ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:24.878504 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-e7eb33cd-8bbf-4142-8d61-d2e1c7b711ee admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071392 Apr 19 03:31:24.879952 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1322 bytes} [Mon Apr 19 03:31:24 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:31:27.409318 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-29a01c85-4c7f-4923-9487-37c6a1bad270 admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:31:27.410399 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-29a01c85-4c7f-4923-9487-37c6a1bad270 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Apr 19 03:31:27.415731 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:31:27 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:31:27.478530 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7ac3d93b-75d9-4ccf-bf1c-ddf48c5e2157 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "ram": 16384}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:27.539870 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7ac3d93b-75d9-4ccf-bf1c-ddf48c5e2157 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.122491 Apr 19 03:31:27.540727 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1272 bytes} [Mon Apr 19 03:31:27 2021] POST /compute/v2.1/flavors => generated 408 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 19 03:31:27.553687 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-342031b4-4085-4de5-b01d-fd5d2f9dfa8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:31:27.655050 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-342031b4-4085-4de5-b01d-fd5d2f9dfa8e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105260 Apr 19 03:31:27.664317 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1322 bytes} [Mon Apr 19 03:31:27 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:32:09.409038 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7ac3d93b-75d9-4ccf-bf1c-ddf48c5e2157 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:09.410100 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7ac3d93b-75d9-4ccf-bf1c-ddf48c5e2157 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Apr 19 03:32:09.410537 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 920 bytes} [Mon Apr 19 03:32:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:32:09.471276 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-b2b8f81d-f843-485b-aa1d-740ebb82e210 admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:09.497263 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-b2b8f81d-f843-485b-aa1d-740ebb82e210 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080194 Apr 19 03:32:09.497831 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1281 bytes} [Mon Apr 19 03:32:09 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:32:11.150566 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7ac3d93b-75d9-4ccf-bf1c-ddf48c5e2157 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:11.151648 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7ac3d93b-75d9-4ccf-bf1c-ddf48c5e2157 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Apr 19 03:32:11.152084 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:32:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:32:11.335666 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-28f1cd44-87b9-473f-867f-a011f3bab186 admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:11.350149 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.wsgi [None req-28f1cd44-87b9-473f-867f-a011f3bab186 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 19 03:32:11.350772 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-28f1cd44-87b9-473f-867f-a011f3bab186 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:32:11.351678 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-28f1cd44-87b9-473f-867f-a011f3bab186 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.070707 Apr 19 03:32:11.352269 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1181 bytes} [Mon Apr 19 03:32:11 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 19 03:32:11.363006 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-b6412027-8eed-42c1-a1be-4227059f94d4 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:11.384333 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-b6412027-8eed-42c1-a1be-4227059f94d4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025213 Apr 19 03:32:11.384900 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1201 bytes} [Mon Apr 19 03:32:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:32:11.394866 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-ba487809-0f6d-47b0-b19a-d0de44348081 admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:11.417192 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-ba487809-0f6d-47b0-b19a-d0de44348081 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026068 Apr 19 03:32:11.417748 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1201 bytes} [Mon Apr 19 03:32:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:32:11.427399 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-93922faa-1068-46a3-8471-6bd7b524c23b admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:11.441053 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.wsgi [None req-93922faa-1068-46a3-8471-6bd7b524c23b admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 19 03:32:11.441675 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-93922faa-1068-46a3-8471-6bd7b524c23b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:32:11.442509 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-93922faa-1068-46a3-8471-6bd7b524c23b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.018846 Apr 19 03:32:11.443045 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1181 bytes} [Mon Apr 19 03:32:11 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 19 03:32:12.997622 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-ba487809-0f6d-47b0-b19a-d0de44348081 admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:12.998823 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-ba487809-0f6d-47b0-b19a-d0de44348081 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Apr 19 03:32:12.999292 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:32:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:32:13.180454 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-91161780-dd94-4559-a7f8-eb4ee0a8acf3 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:13.193337 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.wsgi [None req-91161780-dd94-4559-a7f8-eb4ee0a8acf3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 19 03:32:13.193951 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-91161780-dd94-4559-a7f8-eb4ee0a8acf3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:32:13.194837 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-91161780-dd94-4559-a7f8-eb4ee0a8acf3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.067748 Apr 19 03:32:13.195443 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1181 bytes} [Mon Apr 19 03:32:13 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 19 03:32:13.205477 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7b019c66-fcf4-4a8a-9c9a-1bdde482a4ab admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:13.227176 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7b019c66-fcf4-4a8a-9c9a-1bdde482a4ab admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025708 Apr 19 03:32:13.227763 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1201 bytes} [Mon Apr 19 03:32:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:32:13.238181 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-6a0258c2-1f6c-4763-876f-55efc098f056 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:13.259609 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-6a0258c2-1f6c-4763-876f-55efc098f056 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024508 Apr 19 03:32:13.260179 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1201 bytes} [Mon Apr 19 03:32:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:32:13.269833 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-fa81207f-873a-4317-88d0-5d5c0e23c8ef admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:13.282939 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.wsgi [None req-fa81207f-873a-4317-88d0-5d5c0e23c8ef admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 19 03:32:13.283577 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-fa81207f-873a-4317-88d0-5d5c0e23c8ef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:32:13.284405 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-fa81207f-873a-4317-88d0-5d5c0e23c8ef admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018303 Apr 19 03:32:13.284940 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1181 bytes} [Mon Apr 19 03:32:13 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 19 03:32:14.850575 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-6a0258c2-1f6c-4763-876f-55efc098f056 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:14.851703 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-6a0258c2-1f6c-4763-876f-55efc098f056 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Apr 19 03:32:14.852141 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:32:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:32:15.033295 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-9ddc1334-f3ad-4a08-a873-963b4ec3732f admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:15.046547 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.wsgi [None req-9ddc1334-f3ad-4a08-a873-963b4ec3732f admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 19 03:32:15.047202 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-9ddc1334-f3ad-4a08-a873-963b4ec3732f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:32:15.048045 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-9ddc1334-f3ad-4a08-a873-963b4ec3732f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.068558 Apr 19 03:32:15.048590 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1184 bytes} [Mon Apr 19 03:32:14 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 19 03:32:15.059116 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-d6c467d7-985c-43d6-b178-4a343edc7cc3 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:15.080205 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-d6c467d7-985c-43d6-b178-4a343edc7cc3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025541 Apr 19 03:32:15.080770 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1201 bytes} [Mon Apr 19 03:32:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:32:15.090991 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:15.112754 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025917 Apr 19 03:32:15.113295 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1201 bytes} [Mon Apr 19 03:32:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:32:15.123200 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-12e9765a-4cb9-4d19-9094-af8cc7e46310 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:15.135682 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.wsgi [None req-12e9765a-4cb9-4d19-9094-af8cc7e46310 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 19 03:32:15.136299 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-12e9765a-4cb9-4d19-9094-af8cc7e46310 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:32:15.137129 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-12e9765a-4cb9-4d19-9094-af8cc7e46310 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017800 Apr 19 03:32:15.137662 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1184 bytes} [Mon Apr 19 03:32:15 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 19 03:32:16.693926 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:16.694991 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Apr 19 03:32:16.695504 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:32:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:32:16.875323 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-3b5ebcda-e22c-43d7-865a-9aef53a51b98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:32:16.926896 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-3b5ebcda-e22c-43d7-865a-9aef53a51b98 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.106025 Apr 19 03:32:16.927541 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1226 bytes} [Mon Apr 19 03:32:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:32:18.496643 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:18.497836 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Apr 19 03:32:18.498275 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:32:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:32:18.682831 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-967fb273-971d-4de3-b0c5-292b40c2fa7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:32:18.737355 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-967fb273-971d-4de3-b0c5-292b40c2fa7e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.109833 Apr 19 03:32:18.737878 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1226 bytes} [Mon Apr 19 03:32:18 2021] POST /compute/v2.1/flavors => generated 405 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:32:20.295509 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:20.296626 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Apr 19 03:32:20.297061 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:32:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:32:20.480078 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-c4e69f33-d590-4749-b28c-c782f4c052fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:32:20.585940 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-c4e69f33-d590-4749-b28c-c782f4c052fc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.159335 Apr 19 03:32:20.586546 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1226 bytes} [Mon Apr 19 03:32:20 2021] POST /compute/v2.1/flavors => generated 407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:32:22.140434 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:22.141510 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Apr 19 03:32:22.141991 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:32:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:32:22.321921 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-1ce808d1-ef3b-4c38-8cab-d8af7ab8c57c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:32:22.381230 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-1ce808d1-ef3b-4c38-8cab-d8af7ab8c57c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.112661 Apr 19 03:32:22.381742 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1226 bytes} [Mon Apr 19 03:32:22 2021] POST /compute/v2.1/flavors => generated 409 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:32:23.951669 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:23.952749 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Apr 19 03:32:23.953188 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:32:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:32:24.133500 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-afff86c0-5f23-402a-ae66-645b7bd4b190 admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:32:24.160856 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-afff86c0-5f23-402a-ae66-645b7bd4b190 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.081045 Apr 19 03:32:24.161366 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Apr 19 03:32:24 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:33:14.565522 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:33:14.566588 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7bb0e665-691b-433b-aaad-0180ad9ff4cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Apr 19 03:33:14.567178 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 31/63] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:33:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:33:14.750244 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7abf800f-fddc-46fa-97bb-df59193716ef admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:33:14.778524 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7abf800f-fddc-46fa-97bb-df59193716ef admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.082666 Apr 19 03:33:14.779036 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1193 bytes} [Mon Apr 19 03:33:14 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:34:49.911956 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-e8c06698-dd1a-42ae-a802-b6eb409959e5 tempest-verify_tempest_config-670080887 tempest-verify_tempest_config-670080887-project] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:34:49.914047 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-e8c06698-dd1a-42ae-a802-b6eb409959e5 tempest-verify_tempest_config-670080887 tempest-verify_tempest_config-670080887-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.122292 Apr 19 03:34:49.914639 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1124 bytes} [Mon Apr 19 03:34:49 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:36:19.873887 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7abf800f-fddc-46fa-97bb-df59193716ef admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:36:19.874991 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7abf800f-fddc-46fa-97bb-df59193716ef admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Apr 19 03:36:19.875453 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 34/66] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:36:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:36:20.127301 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-d6443573-c669-4ca2-bcc1-e520636b45db admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:36:20.128654 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:36:20.128654 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: warnings.warn(msg) Apr 19 03:36:20.130757 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-d6443573-c669-4ca2-bcc1-e520636b45db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:36:20.131276 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-d6443573-c669-4ca2-bcc1-e520636b45db admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:36:20.132164 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-d6443573-c669-4ca2-bcc1-e520636b45db admin admin] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:36:20.132639 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-d6443573-c669-4ca2-bcc1-e520636b45db admin admin] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:36:20.173887 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-d6443573-c669-4ca2-bcc1-e520636b45db admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.171559 Apr 19 03:36:20.174526 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1184 bytes} [Mon Apr 19 03:36:20 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:36:21.748864 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-7abf800f-fddc-46fa-97bb-df59193716ef admin admin] Calling method '>' {{(pid=85744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:36:21.750044 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-7abf800f-fddc-46fa-97bb-df59193716ef admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Apr 19 03:36:21.750641 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85744|app: 0|req: 35/68] 10.222.0.25 () {56 vars in 1065 bytes} [Mon Apr 19 03:36:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:36:21.933801 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG nova.api.openstack.wsgi [None req-c416f44f-e34f-4b00-9ff8-2710db740651 admin admin] Calling method '>' {{(pid=85745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:36:21.935106 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:36:21.935106 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: warnings.warn(msg) Apr 19 03:36:21.936781 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-c416f44f-e34f-4b00-9ff8-2710db740651 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:36:21.937284 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-c416f44f-e34f-4b00-9ff8-2710db740651 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:36:21.938134 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-c416f44f-e34f-4b00-9ff8-2710db740651 admin admin] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:36:21.938609 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: DEBUG oslo_concurrency.lockutils [None req-c416f44f-e34f-4b00-9ff8-2710db740651 admin admin] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85745) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:36:21.966130 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: INFO nova.api.openstack.requestlog [None req-c416f44f-e34f-4b00-9ff8-2710db740651 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.087043 Apr 19 03:36:21.966658 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: [pid: 85745|app: 0|req: 34/69] 10.222.0.25 () {60 vars in 1184 bytes} [Mon Apr 19 03:36:21 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:37:16.948959 dv-cinder-786054-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 19 03:37:16.949387 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: Mon Apr 19 03:37:16 2021 - graceful shutdown triggered... Apr 19 03:37:16.949814 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: Gracefully killing worker 1 (pid: 85744)... Apr 19 03:37:16.950021 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: Gracefully killing worker 2 (pid: 85745)... Apr 19 03:37:17.950120 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: worker 1 buried after 1 seconds Apr 19 03:37:17.950120 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: worker 2 buried after 1 seconds Apr 19 03:37:17.950120 dv-cinder-786054-3-iscsi devstack@n-api.service[85743]: goodbye to uWSGI. Apr 19 03:37:17.951819 dv-cinder-786054-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 19 03:37:17.953522 dv-cinder-786054-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 19 03:37:17.961369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: *** Starting uWSGI 2.0.15-debian (64bit) on [Mon Apr 19 03:37:17 2021] *** Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: nodename: dv-cinder-786054-3-iscsi Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: machine: x86_64 Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: clock source: unix Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: pcre jit disabled Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: detected number of CPU cores: 4 Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: current working directory: / Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: detected binary path: /usr/bin/uwsgi-core Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: dropping root privileges as early as possible Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: your processes number limit is 47843 Apr 19 03:37:17.963320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: your memory page size is 4096 bytes Apr 19 03:37:17.964548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: detected max file descriptor number: 2048 Apr 19 03:37:17.964548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: lock engine: pthread robust mutexes Apr 19 03:37:17.964548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: thunder lock: enabled Apr 19 03:37:17.964548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 19 03:37:17.964548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: dropping root privileges after socket binding Apr 19 03:37:17.964548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 19 03:37:18.009692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Python main interpreter initialized at 0x55ebb5bd29c0 Apr 19 03:37:18.009692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: dropping root privileges after plugin initialization Apr 19 03:37:18.009692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: python threads support enabled Apr 19 03:37:18.009692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: your server socket listen backlog is limited to 100 connections Apr 19 03:37:18.009692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: your mercy for graceful operations on workers is 90 seconds Apr 19 03:37:18.010260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: mapped 402621 bytes (393 KB) for 2 cores Apr 19 03:37:18.010260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: *** Operational MODE: preforking *** Apr 19 03:37:18.010474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: dropping root privileges after application loading Apr 19 03:37:18.010474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: *** uWSGI is running in multiple interpreter mode *** Apr 19 03:37:18.010474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: spawned uWSGI master process (pid: 100588) Apr 19 03:37:18.010523 dv-cinder-786054-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 19 03:37:18.010874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: spawned uWSGI worker 1 (pid: 100590, cores: 1) Apr 19 03:37:18.011565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: spawned uWSGI worker 2 (pid: 100591, cores: 1) Apr 19 03:37:18.011565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 19 03:37:23.240799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 19 03:37:23.240799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 19 03:37:23.240799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 19 03:37:23.240799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 19 03:37:23.240799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 19 03:37:23.240799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.241680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 19 03:37:23.241767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.241853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 19 03:37:23.241935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.241935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.241935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.241935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.241935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.243243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 19 03:37:23.243328 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.243411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 19 03:37:23.243493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.243573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 19 03:37:23.243666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.243748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.243831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.243910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.243992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786054-3-iscsi {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244459 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244459 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.244990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.245064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.245064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.245208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.245295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.245374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.246079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786054-3-iscsi {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.246274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.246435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.246594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.246741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.246899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.247045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.247749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.248187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.248344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.248498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.248656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.248820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.248971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.249116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.249269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.249269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.249563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.249726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786054-3-iscsi {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.249872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.250022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.250166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.250330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.250479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.250637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.250789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.250933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.251076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.251262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.251419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.251563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.251743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.251899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.252044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.252199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.252343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.252533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.252679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.252828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.252985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786054-3-iscsi {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.253139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.253289 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.253433 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.253593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.253746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.253890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.254040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.254184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.254330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.254490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.254640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.254792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.254948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.255098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.255290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.256254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.256365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.256365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.256519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.256598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.256690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.256767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.256850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.256925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.257006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.257088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.257171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.257252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.257336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.257410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.257646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.257752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.257878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.258188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.258341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.258423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.258584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.258778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.258940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.259129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.259261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.259539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.259653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.259892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.260001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.260243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.260350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.260575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.260685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.260882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.261001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.261255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.261619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.261807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.261998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.262192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.262325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.262584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.262772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.262953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.263250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.263401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.263519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.263690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.263819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.264058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.264201 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.264420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.264553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.265368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.265555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.265775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.265931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.266040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.266235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.266349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.266457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.266566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.266667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.266667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.266851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.266851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.267055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.267172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.267286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.267626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.267780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.267943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.268750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.268882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.269114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.269261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.269479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.269623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.269848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.270007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.270150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.270302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.270477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.270632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.270829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.270978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.271172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.271322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.271533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.271690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.271887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.272033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.272344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.272494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.272611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.272735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.272894 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.273016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.273235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.273364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.273578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.273709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.273927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.274066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.274272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.274391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.274617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.274732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.274935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.275052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.275312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.275673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.277294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.277430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.277558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.277669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.277770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.277870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.277981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.278089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.278189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.278297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.278403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.278509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.278616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.278717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.278821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.278928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.279028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.279177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.279281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.279392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.279682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.279787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.280511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.280632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.280717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.280792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.280872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.280953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.281034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.281133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.281353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.281451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.281701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.281786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.282053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.282151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.282472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.282579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.282731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.282818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.283079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.283188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.286616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.286737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.286828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.286914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.287908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.288014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.288123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.288223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.288328 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.288434 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.288541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.288648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.288756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.288856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.288955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.289053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.289151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.289266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.289376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.289483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.289483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.289712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.289821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.289934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.290034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.290134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.290240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.290339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.290522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.290653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.290890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.290995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 19 03:37:23.291298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.291513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.291667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.291875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.292237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.292343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.292609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.292763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.292968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.293076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.293354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.293458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.293723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.293823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.294087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.294202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.294453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.294552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.294801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.294932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.295176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.295292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.295563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.295682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.295917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.296042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.296262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.296376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.296667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.296776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.297025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.297137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.297383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.297488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.297749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.297855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.298105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.298210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.298455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.298558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.298817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.298929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.299289 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.299403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.300070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.300191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.300293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.300406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.300507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.300606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.300712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.300818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.300965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.301078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.301329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.301441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.301693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.301809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.302044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.302161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.302401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.302504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.302749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.302854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.303107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.303237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.303528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.303713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.303864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.304232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.304423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.304639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.304749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.305009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.305111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.305373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.305486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.305692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.305833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.306111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.306346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.306467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.306708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.306825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.307074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.307204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.307467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.307605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.307844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.307930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.308234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.308320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.308593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.308686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.308958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.309686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.309686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.309903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.310024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.310146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.310146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.310371 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.310590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.310723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.310842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.310968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.311088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.311252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.311369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.311482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.311683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.311825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.312035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.312158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.312385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.312555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.312798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.312939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.313269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.314081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.314240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.314398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.314521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.314635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.314743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.314874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.314987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.315095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.315251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.315362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.315463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.315573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.315882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.316276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.316530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.316676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.316929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.317036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.317301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.317414 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.317667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.317773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.318040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.318145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.318400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.318516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.318751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.318856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.319099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.319285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.319497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.319942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.320053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.320307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.320392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.320692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.320789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.321885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.321998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.322077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.322151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.322230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.322312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.322415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.322521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.322622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.322720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.322820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.322929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.323037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.323157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.323465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.323733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.323820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.324114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.324200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.324487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.324612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.325299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.325412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.325506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.325584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.325658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.325868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.325959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.326045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.326196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.326294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.326553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.326658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.326913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.327029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.327278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.327656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.328017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.328383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.328736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.328985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.329120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.329967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.330112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.330227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.330342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.330342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.331156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.331291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.331839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.331975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.332103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.332218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.332338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.332522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.332647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.332890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.333021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.333253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.333375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.333612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.333742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.333973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.334120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.334329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.334451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.334909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.335047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.335047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.335327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.335449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.335803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.335984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.336167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.336350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.336526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.336758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.336906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.337036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.337248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.337396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.337617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.337748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.337986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.338132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.338362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.338517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.338739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.338874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.339097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.339253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.339486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.339623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.339866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.340044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.340205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.340364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.340855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.341039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.341039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.341334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.341490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.341640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.341798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.341950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.342106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.342262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.342484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.342607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.347164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.347311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.347311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.347540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.347648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.347761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.347882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.347988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.348097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.348206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.348206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.348404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.348517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.348623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.348733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.348836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.348937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.349679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.350416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.350416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.350612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.351257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.351470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.351647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.351806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.351967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.352128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.352293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.352446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.352646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.352813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.353018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.353183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.353399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.353555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.353777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.353953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.354121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.354500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.354680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.354848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.355001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.355190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.355354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.355550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.355719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.355911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.356073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.356237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.356391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.356567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.356720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.356915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.357071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.357237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.357411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.357589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.357778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.357926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.358146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.358251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.358512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.358624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.358875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.359013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.359271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.359638 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.360264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.360626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.360860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.360991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.361457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.361596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.361742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.361875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.361997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.362120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.362352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.362475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.362719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.362850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.363662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.363818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.363818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.364038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.364038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.365654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.365654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.365889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.365889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.366116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.366248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.366369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.366489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.366604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.366723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.366844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.367006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.367135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.367309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.367463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.367463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.367669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.367770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.367858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.367934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.368013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.368093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.368238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.368340 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.368440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.368544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.368644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.368752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.368853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.368957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.369057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.370883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.371067 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.371233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.371366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.371484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.371606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.371722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.371834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.371954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.372074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.372193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.372314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.372434 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.372546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.372666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.372787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.372908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.373021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.373131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.373254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.373377 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.373494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.373606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.373717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.373828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.373947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.374061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.374172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.374291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.374405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.374516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.374634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.374754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.374874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.375000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.375113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.375291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.375429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.375550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.375771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.375914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.376037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.376163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.376389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.376596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.376720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.376950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.377100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.377308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.377496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.377685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.377856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.378039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.378222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.378389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.378581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.378710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.378940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.379054 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.379324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.379681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.379814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.380031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.380153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.380377 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.380506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.380726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.380849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.381111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.381244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.381623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.381771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.381901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.382017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.382136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.382251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.382490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.382626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.382846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.382976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.383259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.383393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.383647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.383830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.383989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.384156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.384344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.384514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.384675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.384782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.384946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.385113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.385280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.385433 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.385593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.385759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.385926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.386093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.386249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.386400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.386587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.386730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.386956 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.387100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.387765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.387960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.388096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.391163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.391307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.391436 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.391547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.391653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.391771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.391879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.391980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.392079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.392179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.392285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.392391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.392496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.392602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.392712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.392817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.392924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.393536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.393536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.393536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.393536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.393536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.393536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.394088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.394088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.394427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.394555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.394798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.394926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.395175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.395279 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.395555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.395655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.395912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.396017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.396282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.396399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.396631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.396739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.396968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.397136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.397326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.397459 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.397673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.397867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.398047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.398210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.398380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.398540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.398689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.398803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.399025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.399170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.399566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.400023 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.400276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.400633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.400997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.401362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.401751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.403192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.403352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.403485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.403609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.403726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.403845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.403972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.404086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.404257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.404375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.404487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.404606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.404711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.404818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.404926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.405035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.405035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.405220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.405325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.405444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.405639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.405743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.405993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.406104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.406345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.406456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.406709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.406819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.407054 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.407193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.407468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.407817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.407949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.408171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.408294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.408557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.409224 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.410041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.410191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.410316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.410430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.410551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.410665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.410665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.410870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.410971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.411077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.411477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.411846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.412216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.412603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.412741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.412994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.413326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.413485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.415197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.415326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.415410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.415493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.415568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.415650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.415732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.415807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.415880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.415952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.416041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.416117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.416190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.416270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.416345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.416437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.416523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.416646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.416899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.416999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.417364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.417464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.417555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.417631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.418008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.418181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.418385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.418510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.418740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.418836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.419094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.419261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.419504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.419858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.420215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.420578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.420935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.421123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.421450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.421603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.421728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.421848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.421962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.422230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.422353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.422610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.422744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.423599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.423785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.423785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.424144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.424144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.424368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.424475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.424575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.424665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.424776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.424863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.424961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.425149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.425261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.425526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.425643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.425897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.426046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.426250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.426362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.426625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.426739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.426986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.427123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.427398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.427522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.427752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.427885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.428109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.428231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.428762 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.428911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.428911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.429149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.429269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.429383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.429496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.429607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.429865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.429996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.430214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.430323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.430601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.430707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.430973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.431079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.431373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.431565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.431726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.431891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.432109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.432271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.432463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.432631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.432815 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.432989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.433173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.433359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.433538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.433716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.433888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.434106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.434233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.434468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.434579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.434827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.434975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.435266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.435449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.435608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.435784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.435937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.436090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.436243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.436395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.436603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.436786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.437030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.437196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.437346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.437496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.437641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.437792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.437957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.438689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.438949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.439130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.439377 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.439493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.439767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.439912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.440441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.440556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.440643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.440720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.440849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.441036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.441255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.441373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.441615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.441723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.442009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.442123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.442367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.442481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.442735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.442857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.443104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.443286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.443502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.443639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.443860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.443985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.444227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.444350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.444585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.444717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.445529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.445681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.445681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.445889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.445990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.446098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.446098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.446296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.446404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.446576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.446709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.446939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.447053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.447325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.447627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.447751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.448008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.448148 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.448361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.448649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.448780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.449041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.449179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.449388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.449521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.449745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.449851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.450103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.450247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.450472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.450607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.450832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.450946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.451229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.451384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.451587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.451710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.451942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.452058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.452296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.452402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.452660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.452773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.453033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.453146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.453424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.453536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.453768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.453872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.454134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.454246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.454504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.454609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.454865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.454970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.455246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.455396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.456128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.456332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.456468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.456711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.456843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.457076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.457214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.457452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.457583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.457914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.458059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.458176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.458289 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.458512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.458643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.458876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.459010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.459273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.459417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.459635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.459759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.459999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.460142 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.460350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.460474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.463185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.463312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.463440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.463525 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.463603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.463686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.463764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.463838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.463920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464169 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.464983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.465064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.465186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.465420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.465804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.466037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.466145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.466488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.466652 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.466832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.467051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.467398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.467511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.467784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.468047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.468156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.468464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.468572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.468824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.468923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.469198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.469305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.469556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.469655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.469910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.470011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.470257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.470359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.471989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.472100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.472100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.472262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.472347 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.472347 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.472490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.472564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.472636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.473076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.473181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.473259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.473333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.473577 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.473677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.473866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.473960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.474133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.474293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.474453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.474648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.474757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.475005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.475203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.475406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.475565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.475774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.475941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.476093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.476250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.476496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.476661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.476819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.476982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.477148 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.477299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.477660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.477827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.477992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.478145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.478295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.478444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.478594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.478749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.478964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.479117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.479866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.480065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.480231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.480383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.480542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.480720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.481476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.481651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.481806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.481980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.482356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.482518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.482668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.482831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.482993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.483200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.483373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.483538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.483697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.483848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.484011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.484170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.484383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.484544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.484696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.485099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.485259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.485419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.485571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.485727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.485727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.486035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.486186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.486346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.486508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.486776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.486937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.487111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.487302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.487478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.487639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.487789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.487939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.488095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.488257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.488409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.488564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.488716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.488866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.489027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.489027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.489322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.489487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.489646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.489798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.490015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.490176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.490327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.490476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.490624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.490781 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.491000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.491518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.491690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.491854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.492012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.492164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.492502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.492671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.492824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.492975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.493132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.493292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.493450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.493614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.493772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.493924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.494090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.494249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.494400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.494550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.494705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.494855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.495005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.495281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.495443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.495607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.495759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.495973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.496146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.496305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.496456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.496605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.496779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.497015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.497183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.497516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.497690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.497852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.498015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.498167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.498325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.498493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.498655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.498850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.499010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.499199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.499358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.499518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.499670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.499833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.499991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.500149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.500312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.500475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.500626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.500783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.500783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.501085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.501085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.501730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.501958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.502125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.502278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.502553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.502807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.502966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.502966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.503318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.503472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.503621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.503771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.503920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.504078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.504236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.504396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.504548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.504705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.504861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.505028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.505179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.505328 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.505479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.505634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.505791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.506015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.506174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.506174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.506468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.506619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.506774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.506937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.507220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.507220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.507592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.507746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.507904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.508055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.508211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.508363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.508513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.508663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.508821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.508978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.509128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.509294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.509452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.509610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.509768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.509920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.510069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.510219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.510375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.510526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.510689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.510840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.510996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.511221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.511551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.511887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.512053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.512206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.512363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.512531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.512759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.513026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.513185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.513343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.513494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.513645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.513814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.514032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.514193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.514344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.514500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.514651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.514800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.514963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.515114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.515300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.515453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.515604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.515765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.515927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.516085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.516237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.516387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.516543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.516702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.516852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.517009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.517182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.517412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.517571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.517731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.517898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.518559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.518713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.518863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.519022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.519242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.519403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.519554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.519712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.519870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.520030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.520182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.520332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.520498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.520649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.520799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.520961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.521113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.521262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.521419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.521729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.522059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.522220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.522371 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.522527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.522699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.522939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100590) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 19 03:37:23.523225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.523225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.523225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.523225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.523225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.523225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.524090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.524090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.524391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.524648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.525034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 19 03:37:23.525323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100591) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 19 03:37:23.557430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_db.sqlalchemy.engines [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100590) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:37:23.563224 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_db.sqlalchemy.engines [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100591) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:37:23.824059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.context [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb(cell1) {{(pid=100590) load_cells /opt/stack/nova/nova/context.py:466}} Apr 19 03:37:23.829393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.context [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb(cell1) {{(pid=100591) load_cells /opt/stack/nova/nova/context.py:466}} Apr 19 03:37:23.829532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:37:23.831457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:37:23.844174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:37:23.844174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:37:23.844413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:37:23.844413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:37:23.844413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:37:23.844413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:37:23.859075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_db.sqlalchemy.engines [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100590) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:37:23.864405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_db.sqlalchemy.engines [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100590) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:37:23.865132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_db.sqlalchemy.engines [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100591) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:37:23.872032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_db.sqlalchemy.engines [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100591) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:37:23.893000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_db.sqlalchemy.engines [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100590) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:37:23.898042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_db.sqlalchemy.engines [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100591) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 19 03:37:23.982608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 19 03:37:23.982608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: from cryptography.utils import int_from_bytes Apr 19 03:37:23.982965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 19 03:37:23.982965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: from cryptography.utils import int_from_bytes Apr 19 03:37:23.983563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 19 03:37:23.983563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: from cryptography.utils import int_from_bytes Apr 19 03:37:23.983948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 19 03:37:23.983948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: from cryptography.utils import int_from_bytes Apr 19 03:37:24.060566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Loading Gnome Apr 19 03:37:24.062098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Loading Gnome Apr 19 03:37:24.082166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Loading Google Apr 19 03:37:24.083184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Loading Google Apr 19 03:37:24.085547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Loading Windows (alt) Apr 19 03:37:24.086558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Loading Windows (alt) Apr 19 03:37:24.090433 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Loading file Apr 19 03:37:24.091443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Loading file Apr 19 03:37:24.091551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Loading keyczar Apr 19 03:37:24.092006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Loading multi Apr 19 03:37:24.092509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Loading keyczar Apr 19 03:37:24.092872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Loading pyfs Apr 19 03:37:24.092993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Loading multi Apr 19 03:37:24.093882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO keyring.backend [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Loading pyfs Apr 19 03:37:24.380271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: WARNING keystonemiddleware.auth_token [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 03:37:24.380946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: WARNING keystonemiddleware.auth_token [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 03:37:24.387383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: WARNING keystonemiddleware.auth_token [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 03:37:24.388114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: WARNING keystonemiddleware.auth_token [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 03:37:24.730342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: WARNING keystonemiddleware.auth_token [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 03:37:24.732039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: WARNING keystonemiddleware.auth_token [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 03:37:24.736397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: WARNING keystonemiddleware.auth_token [None req-6bd5960c-15d7-46c7-b2c7-7bd3e64f0de9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 03:37:24.738616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: WARNING keystonemiddleware.auth_token [None req-53929908-21e5-43da-a169-b1e26ea457d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 03:37:24.742648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ebb5bd29c0 pid: 100591 (default app) Apr 19 03:37:24.744365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ebb5bd29c0 pid: 100590 (default app) Apr 19 03:38:02.768407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c6ff795a-3667-48d4-89c6-0b2b4fb407f2 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Action: 'create', calling method: .version_select at 0x7f9dadb302f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-29084300"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:04.028164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1276240701", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "networks": [{"uuid": "ad106a6d-061d-4eaf-9356-cb6211f27f70"}]}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:04.455059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c6ff795a-3667-48d4-89c6-0b2b4fb407f2 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 2.929577 Apr 19 03:38:04.456147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1145 bytes} [Mon Apr 19 03:38:01 2021] POST /compute/v2.1/os-volumes => generated 343 bytes in 2933 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 19 03:38:04.464006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4bf03bdf-cc2b-4bcb-bad8-79b559f97a3c tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9dadb30b70>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:04.676957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4bf03bdf-cc2b-4bcb-bad8-79b559f97a3c tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/4c95c005-5c85-4b9b-bee0-88777a702cb4" status: 200 len: 351 microversion: 2.1 time: 0.216516 Apr 19 03:38:04.687480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:38:04 2021] GET /compute/v2.1/os-volumes/4c95c005-5c85-4b9b-bee0-88777a702cb4 => generated 351 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:04.695036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e8b30522-c66d-4f9b-b9fe-17dcd45803eb tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dadaf4d08>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:04.708341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] validate_networks() for [('ad106a6d-061d-4eaf-9356-cb6211f27f70', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:38:05.067857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e8b30522-c66d-4f9b-b9fe-17dcd45803eb tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9b2629eb-fb55-4bcc-a245-f913b1cd99ef" status: 200 len: 344 microversion: 2.1 time: 0.376296 Apr 19 03:38:05.068436 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 3/3] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:38:04 2021] GET /compute/v2.1/os-volumes/9b2629eb-fb55-4bcc-a245-f913b1cd99ef => generated 344 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:05.141677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1786396551", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "networks": [{"uuid": "c6488502-d478-4c15-aad9-cec2dbbd6c1f"}]}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:05.299631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] validate_networks() for [('c6488502-d478-4c15-aad9-cec2dbbd6c1f', None, None, None)] {{(pid=100591) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:38:06.504669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:38:06.505144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:38:06.505623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:38:06.506458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:38:06.507101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:38:06.525858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:06.526546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:06.527607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:06.528571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:06.560582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Getting quotas for project dc1d56df10834f75acdb214616014031. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:38:06.567188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Getting quotas for user 19995635214248febf6983e992840a65 and project dc1d56df10834f75acdb214616014031. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:38:06.582265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:38:06.586342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:38:06.741872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c1ad7e70-2ae5-4de7-bf98-9fc74bf8d880 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.799473 Apr 19 03:38:06.752241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 1/4] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:38:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 3811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:38:06.761178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f6dee1b0-b6f2-4cd7-976b-60d1760193a4 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Action: 'create', calling method: .version_select at 0x7f9dada4cc80>, body: {"snapshot": {"volume_id": "9b2629eb-fb55-4bcc-a245-f913b1cd99ef", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1966279716"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:07.562519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Flavor limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:38:07.562947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Image limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:38:07.563372 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Flavor pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:38:07.563825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Image pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:38:07.564274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:38:07.586779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f6dee1b0-b6f2-4cd7-976b-60d1760193a4 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.832092 Apr 19 03:38:07.588497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 2/5] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Apr 19 03:38:06 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:07.600866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f38e3bd6-e39a-4fa3-8357-2753925fd243 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9dadbed9d8>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:07.607975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:07.608465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:07.609302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:07.619112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:07.683884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Getting quotas for project 3a4502ef85b348a384aa26343b925024. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:38:07.690299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Getting quotas for user 7230efa31a8f47ca95af1f576f73cd90 and project 3a4502ef85b348a384aa26343b925024. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:38:07.709015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Going to run 1 instances... {{(pid=100591) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:38:07.716907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:38:07.839818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f38e3bd6-e39a-4fa3-8357-2753925fd243 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/64e99540-a479-4ce1-a74e-fec8b0806322" status: 200 len: 351 microversion: 2.1 time: 0.249923 Apr 19 03:38:07.844367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:38:07 2021] GET /compute/v2.1/os-volumes/64e99540-a479-4ce1-a74e-fec8b0806322 => generated 351 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:07.850344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0980a7b4-d9e7-4f9a-9f99-798cf2ed19cb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:07.851455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0980a7b4-d9e7-4f9a-9f99-798cf2ed19cb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:08.020428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-906e847f-90b8-4f6b-848e-adc21feab5b5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.950082 Apr 19 03:38:08.021803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 4/7] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:38:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 2952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:38:08.027787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8ffb5ca6-bf12-4be0-ae1d-f1e2aac77983 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad918268>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:08.051193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0980a7b4-d9e7-4f9a-9f99-798cf2ed19cb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:08.073586 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0980a7b4-d9e7-4f9a-9f99-798cf2ed19cb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1215 microversion: 2.1 time: 0.227592 Apr 19 03:38:08.085192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:07 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:08.090694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-65de8874-8271-48fa-a4bc-581762e7d53a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:08.099759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-65de8874-8271-48fa-a4bc-581762e7d53a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:08.207603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-65de8874-8271-48fa-a4bc-581762e7d53a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:08.217428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-65de8874-8271-48fa-a4bc-581762e7d53a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1218 microversion: 2.1 time: 0.130718 Apr 19 03:38:08.218227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:08 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:08.367381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8ffb5ca6-bf12-4be0-ae1d-f1e2aac77983 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6" status: 200 len: 287 microversion: 2.1 time: 0.343874 Apr 19 03:38:08.373215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 5/10] 10.222.0.25 () {58 vars in 1241 bytes} [Mon Apr 19 03:38:08 2021] GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6 => generated 287 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:08.379002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-44590aab-9b7f-48e7-8ae5-8fc3ccc5c02d tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad1130d0>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:08.462280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-44590aab-9b7f-48e7-8ae5-8fc3ccc5c02d tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.085258 Apr 19 03:38:08.462280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1130 bytes} [Mon Apr 19 03:38:08 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:08.471774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6029c348-89f5-4ecb-bc9e-0a7a3290fa56 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad918840>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:08.591849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6029c348-89f5-4ecb-bc9e-0a7a3290fa56 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6" status: 200 len: 287 microversion: 2.1 time: 0.119429 Apr 19 03:38:08.591849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1241 bytes} [Mon Apr 19 03:38:08 2021] GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:09.093371 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-231c3479-5c7e-48f4-8f2a-92147ac35798 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:09.094049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-231c3479-5c7e-48f4-8f2a-92147ac35798 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:09.105466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-231c3479-5c7e-48f4-8f2a-92147ac35798 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:09.106461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-231c3479-5c7e-48f4-8f2a-92147ac35798 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:09.110658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-231c3479-5c7e-48f4-8f2a-92147ac35798 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:09.112118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-231c3479-5c7e-48f4-8f2a-92147ac35798 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:09.237612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-424ef4c1-2319-4abe-a9c3-7c6d46d293da tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:09.239592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-424ef4c1-2319-4abe-a9c3-7c6d46d293da tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:09.357979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-231c3479-5c7e-48f4-8f2a-92147ac35798 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:09.372826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-231c3479-5c7e-48f4-8f2a-92147ac35798 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1219 microversion: 2.1 time: 0.283612 Apr 19 03:38:09.376431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:09 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1219 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:09.449596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-424ef4c1-2319-4abe-a9c3-7c6d46d293da tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:09.535514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-424ef4c1-2319-4abe-a9c3-7c6d46d293da tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1218 microversion: 2.1 time: 0.303661 Apr 19 03:38:09.546215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:09 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1218 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:09.720817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-751886e9-1bb0-44e1-a9ff-a5b618da3db3 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad104620>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:09.720817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-751886e9-1bb0-44e1-a9ff-a5b618da3db3 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6" status: 200 len: 287 microversion: 2.1 time: 0.058042 Apr 19 03:38:09.720817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1241 bytes} [Mon Apr 19 03:38:09 2021] GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:10.390970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e2e5b554-52b6-4b94-8e57-efed881135fd tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:10.392519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e2e5b554-52b6-4b94-8e57-efed881135fd tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:10.401357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e2e5b554-52b6-4b94-8e57-efed881135fd tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:10.401836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e2e5b554-52b6-4b94-8e57-efed881135fd tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:10.403057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e2e5b554-52b6-4b94-8e57-efed881135fd tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:10.403600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e2e5b554-52b6-4b94-8e57-efed881135fd tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:10.554032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cde7891b-1d74-4cfc-9384-cff24a9034f5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:10.554674 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cde7891b-1d74-4cfc-9384-cff24a9034f5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:10.575727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cde7891b-1d74-4cfc-9384-cff24a9034f5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:10.576281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cde7891b-1d74-4cfc-9384-cff24a9034f5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:10.580862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cde7891b-1d74-4cfc-9384-cff24a9034f5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:10.580862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cde7891b-1d74-4cfc-9384-cff24a9034f5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:10.726286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cde7891b-1d74-4cfc-9384-cff24a9034f5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:10.736268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cde7891b-1d74-4cfc-9384-cff24a9034f5 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1222 microversion: 2.1 time: 0.185871 Apr 19 03:38:10.742987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 9/16] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:10 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1222 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:10.742987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a4b714fe-cc93-4ecc-bfe0-0edece40a163 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad113ea0>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:10.756611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e2e5b554-52b6-4b94-8e57-efed881135fd tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:10.770893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e2e5b554-52b6-4b94-8e57-efed881135fd tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1219 microversion: 2.1 time: 0.383813 Apr 19 03:38:10.782049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 8/17] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:10 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1219 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:10.799030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a4b714fe-cc93-4ecc-bfe0-0edece40a163 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6" status: 200 len: 287 microversion: 2.1 time: 0.060141 Apr 19 03:38:10.803225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 10/18] 10.222.0.25 () {58 vars in 1241 bytes} [Mon Apr 19 03:38:10 2021] GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:11.754610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4a6fa9a0-bbbe-4d3a-91e5-c691043a3e7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:11.755535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4a6fa9a0-bbbe-4d3a-91e5-c691043a3e7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:11.763939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a6fa9a0-bbbe-4d3a-91e5-c691043a3e7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:11.764534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a6fa9a0-bbbe-4d3a-91e5-c691043a3e7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:11.765608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a6fa9a0-bbbe-4d3a-91e5-c691043a3e7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:11.766095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a6fa9a0-bbbe-4d3a-91e5-c691043a3e7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:11.789158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9b1110b7-5609-4f73-9097-25043b94bb60 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:11.790060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9b1110b7-5609-4f73-9097-25043b94bb60 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:11.800034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b1110b7-5609-4f73-9097-25043b94bb60 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:11.800513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b1110b7-5609-4f73-9097-25043b94bb60 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:11.801348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b1110b7-5609-4f73-9097-25043b94bb60 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:11.801837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b1110b7-5609-4f73-9097-25043b94bb60 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:11.960294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9b1110b7-5609-4f73-9097-25043b94bb60 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:11.971163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9b1110b7-5609-4f73-9097-25043b94bb60 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1267 microversion: 2.1 time: 0.185923 Apr 19 03:38:11.971775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 11/19] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:11 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:11.977706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-77142612-e14a-4134-b672-fb60961be486 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad056268>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:12.030235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-77142612-e14a-4134-b672-fb60961be486 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6" status: 200 len: 288 microversion: 2.1 time: 0.056668 Apr 19 03:38:12.030852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 12/20] 10.222.0.25 () {58 vars in 1241 bytes} [Mon Apr 19 03:38:11 2021] GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6 => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:12.043228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fa7af28e-738e-4bce-8313-ecad7dd7dfa2 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad056730>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:12.072671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4a6fa9a0-bbbe-4d3a-91e5-c691043a3e7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:12.085795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4a6fa9a0-bbbe-4d3a-91e5-c691043a3e7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1214 microversion: 2.1 time: 0.335462 Apr 19 03:38:12.086417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 9/21] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:11 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1214 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:12.212779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fa7af28e-738e-4bce-8313-ecad7dd7dfa2 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6" status: 202 len: 0 microversion: 2.1 time: 0.174222 Apr 19 03:38:12.213904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 13/22] 10.222.0.25 () {58 vars in 1244 bytes} [Mon Apr 19 03:38:12 2021] DELETE /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:38:12.222812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-add362ac-eb09-4e5f-9845-576b1a2c6e45 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad92ff28>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:12.271550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-add362ac-eb09-4e5f-9845-576b1a2c6e45 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6" status: 200 len: 287 microversion: 2.1 time: 0.053185 Apr 19 03:38:12.272705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 10/23] 10.222.0.25 () {58 vars in 1241 bytes} [Mon Apr 19 03:38:12 2021] GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:12.995220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e8acd1ef-a992-4223-bbed-92f341b7ce08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:12.996547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e8acd1ef-a992-4223-bbed-92f341b7ce08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:13.005951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8acd1ef-a992-4223-bbed-92f341b7ce08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:13.006746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8acd1ef-a992-4223-bbed-92f341b7ce08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:13.007786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8acd1ef-a992-4223-bbed-92f341b7ce08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:13.008429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8acd1ef-a992-4223-bbed-92f341b7ce08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:13.110565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f4eaef97-f4fb-4a39-8517-56d77fc81fae tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:13.111468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f4eaef97-f4fb-4a39-8517-56d77fc81fae tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:13.119844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f4eaef97-f4fb-4a39-8517-56d77fc81fae tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:13.120547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f4eaef97-f4fb-4a39-8517-56d77fc81fae tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:13.121539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f4eaef97-f4fb-4a39-8517-56d77fc81fae tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:13.122181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f4eaef97-f4fb-4a39-8517-56d77fc81fae tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:13.272821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e8acd1ef-a992-4223-bbed-92f341b7ce08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:13.286901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e8acd1ef-a992-4223-bbed-92f341b7ce08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1267 microversion: 2.1 time: 0.300117 Apr 19 03:38:13.288047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 14/24] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:12 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1267 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:13.295913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c4f3a033-804b-4039-b477-f48287613b87 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad0681e0>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:13.324195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f4eaef97-f4fb-4a39-8517-56d77fc81fae tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:13.333937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f4eaef97-f4fb-4a39-8517-56d77fc81fae tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1214 microversion: 2.1 time: 0.228484 Apr 19 03:38:13.335229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 11/25] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:13 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:13.371306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c4f3a033-804b-4039-b477-f48287613b87 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6" status: 200 len: 287 microversion: 2.1 time: 0.081223 Apr 19 03:38:13.374698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 15/26] 10.222.0.25 () {58 vars in 1241 bytes} [Mon Apr 19 03:38:13 2021] GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:14.308348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-44b0bbab-2ef7-4a3f-a7a0-97e19ef30a71 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:14.309616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-44b0bbab-2ef7-4a3f-a7a0-97e19ef30a71 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:14.328335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44b0bbab-2ef7-4a3f-a7a0-97e19ef30a71 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:14.329701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44b0bbab-2ef7-4a3f-a7a0-97e19ef30a71 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:14.331278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44b0bbab-2ef7-4a3f-a7a0-97e19ef30a71 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:14.333520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44b0bbab-2ef7-4a3f-a7a0-97e19ef30a71 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:14.351913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e0342016-9a7e-4318-a807-b75f74d1873d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:14.352578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e0342016-9a7e-4318-a807-b75f74d1873d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:14.362820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e0342016-9a7e-4318-a807-b75f74d1873d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:14.363355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e0342016-9a7e-4318-a807-b75f74d1873d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:14.364209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e0342016-9a7e-4318-a807-b75f74d1873d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:14.364688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e0342016-9a7e-4318-a807-b75f74d1873d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:14.531233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e0342016-9a7e-4318-a807-b75f74d1873d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:14.553217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-44b0bbab-2ef7-4a3f-a7a0-97e19ef30a71 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:14.559861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e0342016-9a7e-4318-a807-b75f74d1873d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1214 microversion: 2.1 time: 0.211859 Apr 19 03:38:14.569871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-44b0bbab-2ef7-4a3f-a7a0-97e19ef30a71 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1267 microversion: 2.1 time: 0.268305 Apr 19 03:38:14.570470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 16/27] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:14 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:14.571445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 12/28] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:14 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:14.585167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2af78a3b-700c-419d-b08b-2a9aa9dbba4c tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad056158>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:14.703278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2af78a3b-700c-419d-b08b-2a9aa9dbba4c tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6" status: 200 len: 287 microversion: 2.1 time: 0.131005 Apr 19 03:38:14.704810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 17/29] 10.222.0.25 () {58 vars in 1241 bytes} [Mon Apr 19 03:38:14 2021] GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:15.528685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ec35b5bd-341c-4f1f-a02c-c6429c556a0d tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9dad056bf8>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:15.584479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-adc980bd-23ec-447b-ae0b-0a538f0bd74d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:15.585245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-adc980bd-23ec-447b-ae0b-0a538f0bd74d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:15.621178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc980bd-23ec-447b-ae0b-0a538f0bd74d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:15.621686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc980bd-23ec-447b-ae0b-0a538f0bd74d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:15.622545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc980bd-23ec-447b-ae0b-0a538f0bd74d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:15.623036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc980bd-23ec-447b-ae0b-0a538f0bd74d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:15.888121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ec35b5bd-341c-4f1f-a02c-c6429c556a0d tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d0e413a1-73f5-485f-a534-9a5ad023fc45" status: 200 len: 351 microversion: 2.1 time: 0.375647 Apr 19 03:38:15.889187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 13/30] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:38:15 2021] GET /compute/v2.1/os-volumes/d0e413a1-73f5-485f-a534-9a5ad023fc45 => generated 351 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:15.894266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3d41cf08-28b3-42ae-94d2-1f7acf5b952b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:15.898002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3d41cf08-28b3-42ae-94d2-1f7acf5b952b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:15.936139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d41cf08-28b3-42ae-94d2-1f7acf5b952b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:15.937437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d41cf08-28b3-42ae-94d2-1f7acf5b952b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:15.946696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d41cf08-28b3-42ae-94d2-1f7acf5b952b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:15.953601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d41cf08-28b3-42ae-94d2-1f7acf5b952b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:16.194790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-adc980bd-23ec-447b-ae0b-0a538f0bd74d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:16.207378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-adc980bd-23ec-447b-ae0b-0a538f0bd74d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1278 microversion: 2.1 time: 0.629441 Apr 19 03:38:16.209115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 18/31] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:15 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1278 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:16.223593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-125bc83b-d251-4bd5-b51f-4befc7d2f96e tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad068598>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:16.580236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3d41cf08-28b3-42ae-94d2-1f7acf5b952b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:16.598379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3d41cf08-28b3-42ae-94d2-1f7acf5b952b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1273 microversion: 2.1 time: 0.707844 Apr 19 03:38:16.611229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 14/32] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:15 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1273 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:16.637816 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bf9e282f-2607-476b-a5c6-1c84207adde6 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9dad0479d8>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:16.661536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-125bc83b-d251-4bd5-b51f-4befc7d2f96e tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] HTTP exception thrown: Snapshot 85027c57-11ee-4b2f-95bc-d488ba41cdc6 could not be found. Apr 19 03:38:16.662200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-125bc83b-d251-4bd5-b51f-4befc7d2f96e tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Returning 404 to user: Snapshot 85027c57-11ee-4b2f-95bc-d488ba41cdc6 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:38:16.663092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-125bc83b-d251-4bd5-b51f-4befc7d2f96e tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6" status: 404 len: 111 microversion: 2.1 time: 0.452977 Apr 19 03:38:16.663979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 19/33] 10.222.0.25 () {58 vars in 1241 bytes} [Mon Apr 19 03:38:16 2021] GET /compute/v2.1/os-snapshots/85027c57-11ee-4b2f-95bc-d488ba41cdc6 => generated 111 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:38:16.672526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ee14a6e7-e05f-4517-8549-49d233c985dc tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad068620>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:16.934396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bf9e282f-2607-476b-a5c6-1c84207adde6 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.318434 Apr 19 03:38:16.936108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 15/34] 10.222.0.25 () {58 vars in 1124 bytes} [Mon Apr 19 03:38:16 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:16.951275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e9d44b17-ca24-4f3e-bd2a-5373cf615ccd tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9dad0069d8>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:17.191538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ee14a6e7-e05f-4517-8549-49d233c985dc tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/9b2629eb-fb55-4bcc-a245-f913b1cd99ef" status: 202 len: 0 microversion: 2.1 time: 0.522635 Apr 19 03:38:17.192458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 20/35] 10.222.0.25 () {58 vars in 1238 bytes} [Mon Apr 19 03:38:16 2021] DELETE /compute/v2.1/os-volumes/9b2629eb-fb55-4bcc-a245-f913b1cd99ef => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:38:17.204153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0cdbcedc-ee92-488c-acb9-346d40917295 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad068b70>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:17.487514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e9d44b17-ca24-4f3e-bd2a-5373cf615ccd tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.540078 Apr 19 03:38:17.495972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 16/36] 10.222.0.25 () {58 vars in 1139 bytes} [Mon Apr 19 03:38:16 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:38:17.502966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1d0c92ab-43ff-411f-b95f-1cc8c989c8bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:17.522565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1d0c92ab-43ff-411f-b95f-1cc8c989c8bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:17.567261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d0c92ab-43ff-411f-b95f-1cc8c989c8bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:17.567777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d0c92ab-43ff-411f-b95f-1cc8c989c8bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:17.570840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d0c92ab-43ff-411f-b95f-1cc8c989c8bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:17.575737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d0c92ab-43ff-411f-b95f-1cc8c989c8bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:17.675897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-0cdbcedc-ee92-488c-acb9-346d40917295 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] HTTP exception thrown: Volume 9b2629eb-fb55-4bcc-a245-f913b1cd99ef could not be found. Apr 19 03:38:17.676658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0cdbcedc-ee92-488c-acb9-346d40917295 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Returning 404 to user: Volume 9b2629eb-fb55-4bcc-a245-f913b1cd99ef could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:38:17.677608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0cdbcedc-ee92-488c-acb9-346d40917295 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9b2629eb-fb55-4bcc-a245-f913b1cd99ef" status: 404 len: 109 microversion: 2.1 time: 0.477544 Apr 19 03:38:17.694852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 21/37] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:38:17 2021] GET /compute/v2.1/os-volumes/9b2629eb-fb55-4bcc-a245-f913b1cd99ef => generated 109 bytes in 495 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:38:17.701773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-37da1d0a-fa6e-4930-ab72-3cc8a4cedbae tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9dad0689d8>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:17.970583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-37da1d0a-fa6e-4930-ab72-3cc8a4cedbae tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.274050 Apr 19 03:38:17.971929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 22/38] 10.222.0.25 () {58 vars in 1124 bytes} [Mon Apr 19 03:38:17 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:17.987869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-02d8f3fb-3023-4216-bb11-10a7100fd42a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:18.007861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-02d8f3fb-3023-4216-bb11-10a7100fd42a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:18.016562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1d0c92ab-43ff-411f-b95f-1cc8c989c8bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:18.029353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1d0c92ab-43ff-411f-b95f-1cc8c989c8bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1276 microversion: 2.1 time: 0.531903 Apr 19 03:38:18.030540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02d8f3fb-3023-4216-bb11-10a7100fd42a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:18.031198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02d8f3fb-3023-4216-bb11-10a7100fd42a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:18.032740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02d8f3fb-3023-4216-bb11-10a7100fd42a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:18.033332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02d8f3fb-3023-4216-bb11-10a7100fd42a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:18.053785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 17/39] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:17 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1276 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:18.059095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-34582e0e-7e61-4e69-88ef-f81a2dfb85f0 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dad0aed08>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:18.333794 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-34582e0e-7e61-4e69-88ef-f81a2dfb85f0 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] HTTP exception thrown: Volume 9b2629eb-fb55-4bcc-a245-f913b1cd99ef could not be found. Apr 19 03:38:18.334521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-34582e0e-7e61-4e69-88ef-f81a2dfb85f0 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Returning 404 to user: Volume 9b2629eb-fb55-4bcc-a245-f913b1cd99ef could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:38:18.335702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-34582e0e-7e61-4e69-88ef-f81a2dfb85f0 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/9b2629eb-fb55-4bcc-a245-f913b1cd99ef" status: 404 len: 109 microversion: 2.1 time: 0.280768 Apr 19 03:38:18.339593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 18/40] 10.222.0.25 () {58 vars in 1238 bytes} [Mon Apr 19 03:38:18 2021] DELETE /compute/v2.1/os-volumes/9b2629eb-fb55-4bcc-a245-f913b1cd99ef => generated 109 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:38:18.343467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-128ce7ce-f6e6-4482-93f6-838e4eb6fe99 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9dad006c80>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:18.807478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-128ce7ce-f6e6-4482-93f6-838e4eb6fe99 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.469584 Apr 19 03:38:18.808590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 19/41] 10.222.0.25 () {58 vars in 1157 bytes} [Mon Apr 19 03:38:18 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:18.816326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-515df209-f18a-448d-b3ce-ece594a2f875 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Calling method '.version_select at 0x7f9dadffed08>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:19.188303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-515df209-f18a-448d-b3ce-ece594a2f875 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] HTTP exception thrown: Volume 9b2629eb-fb55-4bcc-a245-f913b1cd99ef could not be found. Apr 19 03:38:19.188945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-515df209-f18a-448d-b3ce-ece594a2f875 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] Returning 404 to user: Volume 9b2629eb-fb55-4bcc-a245-f913b1cd99ef could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:38:19.190063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-515df209-f18a-448d-b3ce-ece594a2f875 tempest-VolumesSnapshotsTestJSON-1859111565 tempest-VolumesSnapshotsTestJSON-1859111565-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9b2629eb-fb55-4bcc-a245-f913b1cd99ef" status: 404 len: 109 microversion: 2.1 time: 0.380361 Apr 19 03:38:19.190861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 20/42] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:38:18 2021] GET /compute/v2.1/os-volumes/9b2629eb-fb55-4bcc-a245-f913b1cd99ef => generated 109 bytes in 382 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:38:19.206919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1c5b8ee1-6fad-45b3-ae20-e714f8b561bc tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9dad006950>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:19.369823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-02d8f3fb-3023-4216-bb11-10a7100fd42a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:19.382026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-02d8f3fb-3023-4216-bb11-10a7100fd42a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 1.408566 Apr 19 03:38:19.384412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 23/43] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:17 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:19.397491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0c154552-956b-4361-89c0-2404f822a441 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:19.398304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0c154552-956b-4361-89c0-2404f822a441 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:19.421373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c154552-956b-4361-89c0-2404f822a441 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:19.422652 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c154552-956b-4361-89c0-2404f822a441 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:19.426605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c154552-956b-4361-89c0-2404f822a441 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:19.427317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c154552-956b-4361-89c0-2404f822a441 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:19.668879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1c5b8ee1-6fad-45b3-ae20-e714f8b561bc tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.476651 Apr 19 03:38:19.669930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 21/44] 10.222.0.25 () {58 vars in 1160 bytes} [Mon Apr 19 03:38:19 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:19.683385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0539e63b-362a-42ff-b4f6-8487311f6091 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9dad006ae8>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:20.170649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0539e63b-362a-42ff-b4f6-8487311f6091 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.491421 Apr 19 03:38:20.174584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 22/45] 10.222.0.25 () {58 vars in 1145 bytes} [Mon Apr 19 03:38:19 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:20.189610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2308eb1b-b068-48f0-a489-f20a23e01c86 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9db10192f0>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:20.482227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2308eb1b-b068-48f0-a489-f20a23e01c86 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.300066 Apr 19 03:38:20.483110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 23/46] 10.222.0.25 () {58 vars in 1178 bytes} [Mon Apr 19 03:38:20 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:20.491670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b74f6e79-663d-463d-bc55-bf0f5485b266 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:20.493150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b74f6e79-663d-463d-bc55-bf0f5485b266 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:20.516835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b74f6e79-663d-463d-bc55-bf0f5485b266 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:20.518138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b74f6e79-663d-463d-bc55-bf0f5485b266 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:20.518900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b74f6e79-663d-463d-bc55-bf0f5485b266 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:20.519660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b74f6e79-663d-463d-bc55-bf0f5485b266 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:21.993760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b74f6e79-663d-463d-bc55-bf0f5485b266 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:22.006571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b74f6e79-663d-463d-bc55-bf0f5485b266 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 1.521847 Apr 19 03:38:22.015442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 24/47] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:20 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:22.031750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-607d6c72-7bc2-4459-adf5-3465936fae50 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] Calling method '.version_select at 0x7f9db0fdd0d0>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:22.467543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-607d6c72-7bc2-4459-adf5-3465936fae50 tempest-VolumesTestJSON-1710835374 tempest-VolumesTestJSON-1710835374-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.450225 Apr 19 03:38:22.468174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 25/48] 10.222.0.25 () {58 vars in 1145 bytes} [Mon Apr 19 03:38:22 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:22.595006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0c154552-956b-4361-89c0-2404f822a441 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:22.606519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0c154552-956b-4361-89c0-2404f822a441 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 3.220304 Apr 19 03:38:22.607192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 24/49] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:19 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 3222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:22.889319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5b36121c-78e5-44cf-8ab8-e49c7d422ac1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'create', calling method: .version_select at 0x7f9dad0061e0>, body: {"keypair": {"name": "tempest-keypair-1112102942"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:23.008753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1670392801", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa0bf452-e9f3-46b0-a3ef-07a35a7ed8fa"}]}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:23.066322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-5b36121c-78e5-44cf-8ab8-e49c7d422ac1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for project 2853b10cb882499b9bb1d15de040c189. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:38:23.076419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-5b36121c-78e5-44cf-8ab8-e49c7d422ac1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for user fe48ae85de1643bc82155a724a28eb93 and project 2853b10cb882499b9bb1d15de040c189. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:38:23.391904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] validate_networks() for [('fa0bf452-e9f3-46b0-a3ef-07a35a7ed8fa', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:38:23.598631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-5b36121c-78e5-44cf-8ab8-e49c7d422ac1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for project 2853b10cb882499b9bb1d15de040c189. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:38:23.617421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-5b36121c-78e5-44cf-8ab8-e49c7d422ac1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for user fe48ae85de1643bc82155a724a28eb93 and project 2853b10cb882499b9bb1d15de040c189. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:38:23.679664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5b36121c-78e5-44cf-8ab8-e49c7d422ac1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.209843 Apr 19 03:38:23.683367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1148 bytes} [Mon Apr 19 03:38:22 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:23.704167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-36fbab91-0ce0-4d13-b1af-e2d6e8100b31 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:23.704863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-36fbab91-0ce0-4d13-b1af-e2d6e8100b31 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:23.743005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36fbab91-0ce0-4d13-b1af-e2d6e8100b31 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:23.743789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36fbab91-0ce0-4d13-b1af-e2d6e8100b31 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:23.744412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36fbab91-0ce0-4d13-b1af-e2d6e8100b31 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:23.744941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36fbab91-0ce0-4d13-b1af-e2d6e8100b31 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:24.850128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-36fbab91-0ce0-4d13-b1af-e2d6e8100b31 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:24.861594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-36fbab91-0ce0-4d13-b1af-e2d6e8100b31 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 1.177040 Apr 19 03:38:24.862241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 27/51] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:23 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:24.886166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f71333c4-7f5c-4bb3-b838-4a2fc1a6cfb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:24.886842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f71333c4-7f5c-4bb3-b838-4a2fc1a6cfb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:24.928839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f71333c4-7f5c-4bb3-b838-4a2fc1a6cfb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:24.929353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f71333c4-7f5c-4bb3-b838-4a2fc1a6cfb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:24.930208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f71333c4-7f5c-4bb3-b838-4a2fc1a6cfb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:24.930696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f71333c4-7f5c-4bb3-b838-4a2fc1a6cfb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:25.402290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:38:25.404397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:38:25.405317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:38:25.405969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:38:25.407335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:38:25.429237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:25.429962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:25.436366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:25.441513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:25.494442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f71333c4-7f5c-4bb3-b838-4a2fc1a6cfb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:25.505993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Getting quotas for project 35a5401a5a47449f9da4c9331362b020. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:38:25.511589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f71333c4-7f5c-4bb3-b838-4a2fc1a6cfb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.645354 Apr 19 03:38:25.513415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 28/52] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:24 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:25.515406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Getting quotas for user 3249f3b7d8ae4291b4355be0268f92c7 and project 35a5401a5a47449f9da4c9331362b020. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:38:25.553566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:38:25.560250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:38:25.804812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e4ee09df-7c2b-441f-888b-1b550d96d145 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.184371 Apr 19 03:38:25.810128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 25/53] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:38:22 2021] POST /compute/v2.1/servers => generated 383 bytes in 3202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:38:25.818505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3f84cf79-14c8-4bd7-8c56-8ff790e5c770 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:25.820119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3f84cf79-14c8-4bd7-8c56-8ff790e5c770 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:26.159604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-e7e97b56-6e7c-4708-a156-097ac0f7863d req-41f3f995-7a3f-4816-8a03-af92ac6ac52b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e896d6d6-dd30-46c4-a04f-e9225a22a58d", "tag": "bb2c34ca-6d45-4472-864f-42de8bae8411"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:26.162856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:38:26.162856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:38:26.188114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e7e97b56-6e7c-4708-a156-097ac0f7863d req-41f3f995-7a3f-4816-8a03-af92ac6ac52b service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:26.190446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e7e97b56-6e7c-4708-a156-097ac0f7863d req-41f3f995-7a3f-4816-8a03-af92ac6ac52b service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:26.237200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-e7e97b56-6e7c-4708-a156-097ac0f7863d req-41f3f995-7a3f-4816-8a03-af92ac6ac52b service nova] Creating event network-changed:bb2c34ca-6d45-4472-864f-42de8bae8411 for instance e896d6d6-dd30-46c4-a04f-e9225a22a58d on hv-cinder-78605 Apr 19 03:38:26.238033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e7e97b56-6e7c-4708-a156-097ac0f7863d req-41f3f995-7a3f-4816-8a03-af92ac6ac52b service nova] Acquired lock "compute-rpcapi-router" {{(pid=100591) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 19 03:38:26.240080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-716ecc05-6f20-4948-8022-40d13155ea74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:26.240451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-716ecc05-6f20-4948-8022-40d13155ea74 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:26.242597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-716ecc05-6f20-4948-8022-40d13155ea74 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:26.244361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-716ecc05-6f20-4948-8022-40d13155ea74 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:26.267759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.compute.rpcapi [None req-716ecc05-6f20-4948-8022-40d13155ea74 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 19 03:38:26.269039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-716ecc05-6f20-4948-8022-40d13155ea74 None None] Releasing lock "compute-rpcapi-router" {{(pid=100591) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 19 03:38:26.386219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-716ecc05-6f20-4948-8022-40d13155ea74 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.871243 Apr 19 03:38:26.387188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 29/54] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:38:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:26.393130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-84ececd2-0258-4e6d-8b03-61f3320b5f37 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:26.396004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-84ececd2-0258-4e6d-8b03-61f3320b5f37 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:26.435282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84ececd2-0258-4e6d-8b03-61f3320b5f37 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:26.436047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84ececd2-0258-4e6d-8b03-61f3320b5f37 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:26.437222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84ececd2-0258-4e6d-8b03-61f3320b5f37 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:26.438461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84ececd2-0258-4e6d-8b03-61f3320b5f37 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:27.138480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3f84cf79-14c8-4bd7-8c56-8ff790e5c770 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:27.163520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3f84cf79-14c8-4bd7-8c56-8ff790e5c770 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1222 microversion: 2.1 time: 1.338247 Apr 19 03:38:27.168176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 26/55] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:25 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1222 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:27.198657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-168f61f9-d798-403d-8564-0eb3d276c26a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:27.205167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-168f61f9-d798-403d-8564-0eb3d276c26a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:27.240948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-168f61f9-d798-403d-8564-0eb3d276c26a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:27.241687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-168f61f9-d798-403d-8564-0eb3d276c26a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:27.242701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-168f61f9-d798-403d-8564-0eb3d276c26a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:27.246464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-168f61f9-d798-403d-8564-0eb3d276c26a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:27.273162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-84ececd2-0258-4e6d-8b03-61f3320b5f37 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:27.333484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-84ececd2-0258-4e6d-8b03-61f3320b5f37 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.944706 Apr 19 03:38:27.335688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 30/56] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:26 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:27.992188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-81222876", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa0bf452-e9f3-46b0-a3ef-07a35a7ed8fa"}]}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:28.411750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] validate_networks() for [('fa0bf452-e9f3-46b0-a3ef-07a35a7ed8fa', None, None, None)] {{(pid=100591) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:38:29.327093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-168f61f9-d798-403d-8564-0eb3d276c26a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:29.341195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-168f61f9-d798-403d-8564-0eb3d276c26a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 2.171787 Apr 19 03:38:29.341842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 27/57] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:27 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:29.349680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3a242231-04f2-4e1d-89fe-981815387437 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:29.350319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3a242231-04f2-4e1d-89fe-981815387437 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:29.370734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a242231-04f2-4e1d-89fe-981815387437 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:29.379464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a242231-04f2-4e1d-89fe-981815387437 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:29.380903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a242231-04f2-4e1d-89fe-981815387437 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:29.381575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a242231-04f2-4e1d-89fe-981815387437 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:30.113116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3a242231-04f2-4e1d-89fe-981815387437 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:30.122767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3a242231-04f2-4e1d-89fe-981815387437 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.779746 Apr 19 03:38:30.123531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 28/58] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:29 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:30.144765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-e6b6fdc2-5408-4b96-aea0-8e6723c38afe req-28ab8036-f202-4ad3-ac81-86cea9ccb79e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99f109f9-2733-4c58-8a4d-edc40ed82783", "tag": "64a0c86b-eb65-45fc-9eaf-18e538c2f777"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:30.147828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:38:30.147828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:38:30.160055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e6b6fdc2-5408-4b96-aea0-8e6723c38afe req-28ab8036-f202-4ad3-ac81-86cea9ccb79e service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:30.161167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e6b6fdc2-5408-4b96-aea0-8e6723c38afe req-28ab8036-f202-4ad3-ac81-86cea9ccb79e service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:30.200812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-e6b6fdc2-5408-4b96-aea0-8e6723c38afe req-28ab8036-f202-4ad3-ac81-86cea9ccb79e service nova] Creating event network-changed:64a0c86b-eb65-45fc-9eaf-18e538c2f777 for instance 99f109f9-2733-4c58-8a4d-edc40ed82783 on hv-cinder-78605 Apr 19 03:38:30.200812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e6b6fdc2-5408-4b96-aea0-8e6723c38afe req-28ab8036-f202-4ad3-ac81-86cea9ccb79e service nova] Acquired lock "compute-rpcapi-router" {{(pid=100590) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 19 03:38:30.200812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7df497b-31f1-4bb1-9e79-6021d7f06fe9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:30.200812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7df497b-31f1-4bb1-9e79-6021d7f06fe9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:30.201897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7df497b-31f1-4bb1-9e79-6021d7f06fe9 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:30.203091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7df497b-31f1-4bb1-9e79-6021d7f06fe9 None None] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:30.213612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.compute.rpcapi [None req-e7df497b-31f1-4bb1-9e79-6021d7f06fe9 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 19 03:38:30.214910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7df497b-31f1-4bb1-9e79-6021d7f06fe9 None None] Releasing lock "compute-rpcapi-router" {{(pid=100590) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 19 03:38:30.263796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e7df497b-31f1-4bb1-9e79-6021d7f06fe9 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130899 Apr 19 03:38:30.264808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 29/59] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:30.361741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5a952ada-25cf-47cc-89c1-8d285382a910 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:30.362519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5a952ada-25cf-47cc-89c1-8d285382a910 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:30.379296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5a952ada-25cf-47cc-89c1-8d285382a910 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:30.380033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5a952ada-25cf-47cc-89c1-8d285382a910 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:30.383857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5a952ada-25cf-47cc-89c1-8d285382a910 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:30.383857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5a952ada-25cf-47cc-89c1-8d285382a910 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:30.735842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5a952ada-25cf-47cc-89c1-8d285382a910 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:30.761105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5a952ada-25cf-47cc-89c1-8d285382a910 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.404701 Apr 19 03:38:30.761703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 30/60] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:30 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:31.005479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Flavor limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:38:31.006514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Image limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:38:31.009168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Flavor pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:38:31.009857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Image pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:38:31.010775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:38:31.037565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:31.039370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:31.042084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:31.042985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:31.113271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Getting quotas for project 35a5401a5a47449f9da4c9331362b020. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:38:31.120556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Getting quotas for user 3249f3b7d8ae4291b4355be0268f92c7 and project 35a5401a5a47449f9da4c9331362b020. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:38:31.133384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Going to run 1 instances... {{(pid=100591) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:38:31.144296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5458479c-e5bb-4b3c-b94d-8a06663bda8c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:31.145132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5458479c-e5bb-4b3c-b94d-8a06663bda8c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:31.149132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:38:31.163424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5458479c-e5bb-4b3c-b94d-8a06663bda8c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:31.166617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5458479c-e5bb-4b3c-b94d-8a06663bda8c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:31.167808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5458479c-e5bb-4b3c-b94d-8a06663bda8c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:31.172791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5458479c-e5bb-4b3c-b94d-8a06663bda8c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:31.321366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8dbc6bd7-b0a0-4ab5-a24f-cfcac124a667 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.334125 Apr 19 03:38:31.323496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 31/61] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:38:27 2021] POST /compute/v2.1/servers => generated 383 bytes in 3336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:38:31.334566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bd28adda-35bd-47e7-bd19-1c200cb9bc0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:31.335463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bd28adda-35bd-47e7-bd19-1c200cb9bc0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:31.552374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bd28adda-35bd-47e7-bd19-1c200cb9bc0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:31.561768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bd28adda-35bd-47e7-bd19-1c200cb9bc0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1220 microversion: 2.1 time: 0.232568 Apr 19 03:38:31.570637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 32/62] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:31 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1220 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:31.620056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5458479c-e5bb-4b3c-b94d-8a06663bda8c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:31.646048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5458479c-e5bb-4b3c-b94d-8a06663bda8c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.508709 Apr 19 03:38:31.646682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 31/63] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:31 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:31.780487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-92d2a7ea-cf4a-41a4-98d8-97abd6eab7bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:31.781707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-92d2a7ea-cf4a-41a4-98d8-97abd6eab7bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:31.799096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92d2a7ea-cf4a-41a4-98d8-97abd6eab7bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:31.799934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92d2a7ea-cf4a-41a4-98d8-97abd6eab7bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:31.804094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92d2a7ea-cf4a-41a4-98d8-97abd6eab7bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:31.804752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92d2a7ea-cf4a-41a4-98d8-97abd6eab7bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:32.579908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ba7de5ef-1cde-4319-b155-6fe43e83d814 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:32.580581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ba7de5ef-1cde-4319-b155-6fe43e83d814 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:32.595503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba7de5ef-1cde-4319-b155-6fe43e83d814 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:32.596009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba7de5ef-1cde-4319-b155-6fe43e83d814 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:32.596877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba7de5ef-1cde-4319-b155-6fe43e83d814 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:32.597366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba7de5ef-1cde-4319-b155-6fe43e83d814 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:32.848507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-92d2a7ea-cf4a-41a4-98d8-97abd6eab7bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:32.866433 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-92d2a7ea-cf4a-41a4-98d8-97abd6eab7bf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 1.089541 Apr 19 03:38:32.867729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 33/64] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:31 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:32.877271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-86af672a-32fd-477d-92f4-7b9dcc09cb61 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:32.877271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-86af672a-32fd-477d-92f4-7b9dcc09cb61 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:32.896818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86af672a-32fd-477d-92f4-7b9dcc09cb61 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:32.897336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86af672a-32fd-477d-92f4-7b9dcc09cb61 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:32.901678 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86af672a-32fd-477d-92f4-7b9dcc09cb61 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:32.902183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86af672a-32fd-477d-92f4-7b9dcc09cb61 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:32.947485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ba7de5ef-1cde-4319-b155-6fe43e83d814 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:32.959554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ba7de5ef-1cde-4319-b155-6fe43e83d814 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1224 microversion: 2.1 time: 0.383628 Apr 19 03:38:32.960192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:32 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1224 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:33.548845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-86af672a-32fd-477d-92f4-7b9dcc09cb61 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:33.562777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-86af672a-32fd-477d-92f4-7b9dcc09cb61 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.692514 Apr 19 03:38:33.577617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 34/66] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:32 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:33.941624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d6a28ec3-c253-4084-88c3-956b3d3a17e2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:33.941624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d6a28ec3-c253-4084-88c3-956b3d3a17e2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:33.941624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6a28ec3-c253-4084-88c3-956b3d3a17e2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:33.941624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6a28ec3-c253-4084-88c3-956b3d3a17e2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:33.942848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6a28ec3-c253-4084-88c3-956b3d3a17e2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:33.942848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6a28ec3-c253-4084-88c3-956b3d3a17e2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:33.977603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9c3187c9-a870-4291-a499-145013526ec0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:33.978583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9c3187c9-a870-4291-a499-145013526ec0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:33.995864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9c3187c9-a870-4291-a499-145013526ec0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:33.999170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9c3187c9-a870-4291-a499-145013526ec0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:33.999170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9c3187c9-a870-4291-a499-145013526ec0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:33.999170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9c3187c9-a870-4291-a499-145013526ec0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:34.381989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9c3187c9-a870-4291-a499-145013526ec0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:34.393691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9c3187c9-a870-4291-a499-145013526ec0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1280 microversion: 2.1 time: 0.420473 Apr 19 03:38:34.400354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 35/67] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:33 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1280 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:34.406752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-584061961", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43cd66f9-03bd-414d-9d21-4899787c829e"}], "security_groups": [{"name": "tempest-securitygroup--892137182"}], "key_name": "tempest-keypair-1112102942", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:34.732252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d6a28ec3-c253-4084-88c3-956b3d3a17e2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:34.746903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d6a28ec3-c253-4084-88c3-956b3d3a17e2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.865314 Apr 19 03:38:34.769740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 33/68] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:33 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:34.786507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-02e8b50d-2ad7-4f1b-a27e-c36ff9803e42 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:34.787251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-02e8b50d-2ad7-4f1b-a27e-c36ff9803e42 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:34.803048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02e8b50d-2ad7-4f1b-a27e-c36ff9803e42 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:34.803598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02e8b50d-2ad7-4f1b-a27e-c36ff9803e42 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:34.804458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02e8b50d-2ad7-4f1b-a27e-c36ff9803e42 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:34.804952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02e8b50d-2ad7-4f1b-a27e-c36ff9803e42 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:35.093051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] validate_networks() for [('43cd66f9-03bd-414d-9d21-4899787c829e', None, None, None)] {{(pid=100591) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:38:35.145417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-02e8b50d-2ad7-4f1b-a27e-c36ff9803e42 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:35.158671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-02e8b50d-2ad7-4f1b-a27e-c36ff9803e42 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.386572 Apr 19 03:38:35.159426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 34/69] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:34 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:35.418185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b6e6bda0-4463-4383-b719-6d636bfe4b37 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:35.418958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b6e6bda0-4463-4383-b719-6d636bfe4b37 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:35.435660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b6e6bda0-4463-4383-b719-6d636bfe4b37 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:35.436496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b6e6bda0-4463-4383-b719-6d636bfe4b37 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:35.438209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b6e6bda0-4463-4383-b719-6d636bfe4b37 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:35.442799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b6e6bda0-4463-4383-b719-6d636bfe4b37 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:35.666772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b6e6bda0-4463-4383-b719-6d636bfe4b37 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:35.681682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b6e6bda0-4463-4383-b719-6d636bfe4b37 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1278 microversion: 2.1 time: 0.263211 Apr 19 03:38:35.682980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 35/70] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:35 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:35.776187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-806e21a7-64fe-4ce2-99bc-7d7b6d8ce8f2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:35.776855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-806e21a7-64fe-4ce2-99bc-7d7b6d8ce8f2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:35.788174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-806e21a7-64fe-4ce2-99bc-7d7b6d8ce8f2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:35.788928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-806e21a7-64fe-4ce2-99bc-7d7b6d8ce8f2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:35.790102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-806e21a7-64fe-4ce2-99bc-7d7b6d8ce8f2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:35.790213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-806e21a7-64fe-4ce2-99bc-7d7b6d8ce8f2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:36.463771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-806e21a7-64fe-4ce2-99bc-7d7b6d8ce8f2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:36.475364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-806e21a7-64fe-4ce2-99bc-7d7b6d8ce8f2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.703173 Apr 19 03:38:36.476168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 36/71] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:35 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:36.480898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0c33c8bc-46ae-4123-b98b-7038df0abed6 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:36.483877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0c33c8bc-46ae-4123-b98b-7038df0abed6 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:36.505668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c33c8bc-46ae-4123-b98b-7038df0abed6 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:36.508075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c33c8bc-46ae-4123-b98b-7038df0abed6 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:36.510074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c33c8bc-46ae-4123-b98b-7038df0abed6 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:36.511607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c33c8bc-46ae-4123-b98b-7038df0abed6 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:37.094468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Flavor limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:38:37.094936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Image limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:38:37.095594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Flavor pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:38:37.096055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Image pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:38:37.096512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:38:37.111952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:37.115316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:37.116267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:37.116766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:37.160420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for project 2853b10cb882499b9bb1d15de040c189. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:38:37.176252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for user fe48ae85de1643bc82155a724a28eb93 and project 2853b10cb882499b9bb1d15de040c189. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:38:37.193897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Going to run 1 instances... {{(pid=100591) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:38:37.196644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:38:37.270171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0c33c8bc-46ae-4123-b98b-7038df0abed6 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:37.284215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0c33c8bc-46ae-4123-b98b-7038df0abed6 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.807110 Apr 19 03:38:37.285097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 37/72] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:36 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:37.293055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d012a837-26a1-4884-bf48-5bc7620aa73a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:37.312370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d012a837-26a1-4884-bf48-5bc7620aa73a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:37.327120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d012a837-26a1-4884-bf48-5bc7620aa73a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:37.329715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d012a837-26a1-4884-bf48-5bc7620aa73a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:37.332797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d012a837-26a1-4884-bf48-5bc7620aa73a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:37.334869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d012a837-26a1-4884-bf48-5bc7620aa73a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:37.340716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fbb24055-e560-459b-b899-b5d78ecca04a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.939010 Apr 19 03:38:37.354483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 36/73] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:38:34 2021] POST /compute/v2.1/servers => generated 401 bytes in 2953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:38:37.732010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-e7950ded-e759-4c4a-b7de-a02b7625acad req-9af38e9a-3a88-4379-b3da-5fd471a96144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22", "tag": "f3d9b8ab-bbd3-4640-81fd-67706cd12ecc"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:37.732979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:38:37.732979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:38:37.753015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e7950ded-e759-4c4a-b7de-a02b7625acad req-9af38e9a-3a88-4379-b3da-5fd471a96144 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:37.753530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e7950ded-e759-4c4a-b7de-a02b7625acad req-9af38e9a-3a88-4379-b3da-5fd471a96144 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:37.785806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-e7950ded-e759-4c4a-b7de-a02b7625acad req-9af38e9a-3a88-4379-b3da-5fd471a96144 service nova] Creating event network-changed:f3d9b8ab-bbd3-4640-81fd-67706cd12ecc for instance 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 on hv-cinder-78605 Apr 19 03:38:37.791346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-e7950ded-e759-4c4a-b7de-a02b7625acad req-9af38e9a-3a88-4379-b3da-5fd471a96144 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.435371 Apr 19 03:38:37.792397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 37/74] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:38:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:37.800982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f6537b91-cc4d-4bc2-9ae6-8a82c5c90ed7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:37.800982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f6537b91-cc4d-4bc2-9ae6-8a82c5c90ed7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:38.093248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f6537b91-cc4d-4bc2-9ae6-8a82c5c90ed7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:38.102975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f6537b91-cc4d-4bc2-9ae6-8a82c5c90ed7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1237 microversion: 2.1 time: 0.309065 Apr 19 03:38:38.105786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d012a837-26a1-4884-bf48-5bc7620aa73a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:38.106948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 38/75] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:37 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1237 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:38.117813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d012a837-26a1-4884-bf48-5bc7620aa73a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.831460 Apr 19 03:38:38.118661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 38/76] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:37 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:38.119471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-68d34fda-3c11-4c9a-9214-8e52fda7327e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:38.120402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-68d34fda-3c11-4c9a-9214-8e52fda7327e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:38.142895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68d34fda-3c11-4c9a-9214-8e52fda7327e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:38.144778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68d34fda-3c11-4c9a-9214-8e52fda7327e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:38.146806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68d34fda-3c11-4c9a-9214-8e52fda7327e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:38.150142 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68d34fda-3c11-4c9a-9214-8e52fda7327e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:38.511849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-b0116ff4-8083-4ecf-b07f-fa20de378c67 req-9b02b859-6cfd-4a28-b5d8-7771c1cc4861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e896d6d6-dd30-46c4-a04f-e9225a22a58d", "name": "network-vif-plugged", "status": "completed", "tag": "bb2c34ca-6d45-4472-864f-42de8bae8411"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:38.515079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:38:38.515079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:38:38.535571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-b0116ff4-8083-4ecf-b07f-fa20de378c67 req-9b02b859-6cfd-4a28-b5d8-7771c1cc4861 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:38.541124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-b0116ff4-8083-4ecf-b07f-fa20de378c67 req-9b02b859-6cfd-4a28-b5d8-7771c1cc4861 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:38.580612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-b0116ff4-8083-4ecf-b07f-fa20de378c67 req-9b02b859-6cfd-4a28-b5d8-7771c1cc4861 service nova] Creating event network-vif-plugged:bb2c34ca-6d45-4472-864f-42de8bae8411 for instance e896d6d6-dd30-46c4-a04f-e9225a22a58d on hv-cinder-78605 Apr 19 03:38:38.592648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-b0116ff4-8083-4ecf-b07f-fa20de378c67 req-9b02b859-6cfd-4a28-b5d8-7771c1cc4861 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.465435 Apr 19 03:38:38.594385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 39/77] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:38:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:38.627569 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0b939ba0-2d30-4fec-9dba-856767cb06e2 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:38.628384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0b939ba0-2d30-4fec-9dba-856767cb06e2 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:38.643691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b939ba0-2d30-4fec-9dba-856767cb06e2 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:38.656315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b939ba0-2d30-4fec-9dba-856767cb06e2 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:38.661807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b939ba0-2d30-4fec-9dba-856767cb06e2 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:38.661807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b939ba0-2d30-4fec-9dba-856767cb06e2 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:38.941356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-68d34fda-3c11-4c9a-9214-8e52fda7327e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:38.953613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-68d34fda-3c11-4c9a-9214-8e52fda7327e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.842326 Apr 19 03:38:38.954828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 39/78] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:38 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:38.962763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-8f149043-1929-4fcb-9019-4f3b03e5e992 req-b2e1ccf8-2d86-485e-a59a-6c6503256183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a261074-36d1-43c7-aa9f-3b01ef9b22de", "tag": "60e9cad0-05d1-41b7-9493-d8716b118842"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:38.965521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:38:38.965521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:38:38.976469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-8f149043-1929-4fcb-9019-4f3b03e5e992 req-b2e1ccf8-2d86-485e-a59a-6c6503256183 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:38.977465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-8f149043-1929-4fcb-9019-4f3b03e5e992 req-b2e1ccf8-2d86-485e-a59a-6c6503256183 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:38.995109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-8f149043-1929-4fcb-9019-4f3b03e5e992 req-b2e1ccf8-2d86-485e-a59a-6c6503256183 service nova] Creating event network-changed:60e9cad0-05d1-41b7-9493-d8716b118842 for instance 6a261074-36d1-43c7-aa9f-3b01ef9b22de on hv-cinder-78605 Apr 19 03:38:39.000268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-8f149043-1929-4fcb-9019-4f3b03e5e992 req-b2e1ccf8-2d86-485e-a59a-6c6503256183 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043730 Apr 19 03:38:39.001144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 40/79] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:38:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:39.166041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2dd6611e-9aa2-4c31-98bc-8876d42c85b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:39.166041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2dd6611e-9aa2-4c31-98bc-8876d42c85b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:39.166041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dd6611e-9aa2-4c31-98bc-8876d42c85b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:39.166041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dd6611e-9aa2-4c31-98bc-8876d42c85b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:39.166370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dd6611e-9aa2-4c31-98bc-8876d42c85b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:39.166370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dd6611e-9aa2-4c31-98bc-8876d42c85b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:39.354824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0b939ba0-2d30-4fec-9dba-856767cb06e2 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:39.364927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0b939ba0-2d30-4fec-9dba-856767cb06e2 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.769045 Apr 19 03:38:39.365940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 40/80] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:38 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:39.370873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9ed770db-1ca2-4f25-81f2-e4c0bfc0a5ba tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:39.371698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9ed770db-1ca2-4f25-81f2-e4c0bfc0a5ba tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:39.380369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ed770db-1ca2-4f25-81f2-e4c0bfc0a5ba tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:39.381048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ed770db-1ca2-4f25-81f2-e4c0bfc0a5ba tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:39.382026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ed770db-1ca2-4f25-81f2-e4c0bfc0a5ba tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:39.382634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ed770db-1ca2-4f25-81f2-e4c0bfc0a5ba tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:39.423534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2dd6611e-9aa2-4c31-98bc-8876d42c85b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:39.444239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2dd6611e-9aa2-4c31-98bc-8876d42c85b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1233 microversion: 2.1 time: 0.309559 Apr 19 03:38:39.445806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 41/81] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:39 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1233 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:39.897850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9ed770db-1ca2-4f25-81f2-e4c0bfc0a5ba tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:39.906851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9ed770db-1ca2-4f25-81f2-e4c0bfc0a5ba tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.539962 Apr 19 03:38:39.907539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 41/82] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:39 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:39.972151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-57b803a9-45b3-40bc-9779-73a3b9476aab tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:39.972801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-57b803a9-45b3-40bc-9779-73a3b9476aab tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:39.980669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57b803a9-45b3-40bc-9779-73a3b9476aab tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:39.981189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57b803a9-45b3-40bc-9779-73a3b9476aab tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:39.982012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57b803a9-45b3-40bc-9779-73a3b9476aab tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:39.982501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57b803a9-45b3-40bc-9779-73a3b9476aab tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:40.364175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-57b803a9-45b3-40bc-9779-73a3b9476aab tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:40.374163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-57b803a9-45b3-40bc-9779-73a3b9476aab tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.406122 Apr 19 03:38:40.377207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 42/83] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:39 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:40.388455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a8d8894c-e11e-4205-8291-8c12333bf79a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:40.389266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a8d8894c-e11e-4205-8291-8c12333bf79a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:40.399836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a8d8894c-e11e-4205-8291-8c12333bf79a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:40.400679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a8d8894c-e11e-4205-8291-8c12333bf79a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:40.402251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a8d8894c-e11e-4205-8291-8c12333bf79a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:40.403651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a8d8894c-e11e-4205-8291-8c12333bf79a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:40.464268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a6a0b841-0c6e-4f38-9623-30491c262a97 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:40.465385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a6a0b841-0c6e-4f38-9623-30491c262a97 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:40.481774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a6a0b841-0c6e-4f38-9623-30491c262a97 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:40.482477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a6a0b841-0c6e-4f38-9623-30491c262a97 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:40.485757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a6a0b841-0c6e-4f38-9623-30491c262a97 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:40.486837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a6a0b841-0c6e-4f38-9623-30491c262a97 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:40.855639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a6a0b841-0c6e-4f38-9623-30491c262a97 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:40.869840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a6a0b841-0c6e-4f38-9623-30491c262a97 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1289 microversion: 2.1 time: 0.410100 Apr 19 03:38:40.870489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 43/84] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:40 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1289 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:40.926528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ce8f7f42-e66a-4677-b72a-63b9bc275cc2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:40.927208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ce8f7f42-e66a-4677-b72a-63b9bc275cc2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:40.942648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce8f7f42-e66a-4677-b72a-63b9bc275cc2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:40.943181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce8f7f42-e66a-4677-b72a-63b9bc275cc2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:40.951579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce8f7f42-e66a-4677-b72a-63b9bc275cc2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:40.952190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce8f7f42-e66a-4677-b72a-63b9bc275cc2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:41.541498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a8d8894c-e11e-4205-8291-8c12333bf79a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:41.560801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a8d8894c-e11e-4205-8291-8c12333bf79a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 1.176782 Apr 19 03:38:41.565114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 42/85] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:40 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:41.579011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8e76a22d-7dc4-4a62-a267-612a0ae9fe10 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:41.580053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8e76a22d-7dc4-4a62-a267-612a0ae9fe10 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:41.590394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e76a22d-7dc4-4a62-a267-612a0ae9fe10 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:41.591166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e76a22d-7dc4-4a62-a267-612a0ae9fe10 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:41.592231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e76a22d-7dc4-4a62-a267-612a0ae9fe10 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:41.593179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e76a22d-7dc4-4a62-a267-612a0ae9fe10 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:41.741399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ce8f7f42-e66a-4677-b72a-63b9bc275cc2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:41.753424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ce8f7f42-e66a-4677-b72a-63b9bc275cc2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.832723 Apr 19 03:38:41.754049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 44/86] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:40 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:41.765640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-2d60a8a8-884d-45ef-b8f3-1e0740610ed8 req-4a317d52-513e-4ed4-a141-a6209fbe40d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f109f9-2733-4c58-8a4d-edc40ed82783", "name": "network-vif-plugged", "status": "completed", "tag": "64a0c86b-eb65-45fc-9eaf-18e538c2f777"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:41.767671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:38:41.767671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:38:41.786952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-2d60a8a8-884d-45ef-b8f3-1e0740610ed8 req-4a317d52-513e-4ed4-a141-a6209fbe40d5 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:41.788264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-2d60a8a8-884d-45ef-b8f3-1e0740610ed8 req-4a317d52-513e-4ed4-a141-a6209fbe40d5 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:41.807682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-2d60a8a8-884d-45ef-b8f3-1e0740610ed8 req-4a317d52-513e-4ed4-a141-a6209fbe40d5 service nova] Creating event network-vif-plugged:64a0c86b-eb65-45fc-9eaf-18e538c2f777 for instance 99f109f9-2733-4c58-8a4d-edc40ed82783 on hv-cinder-78605 Apr 19 03:38:41.813895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-2d60a8a8-884d-45ef-b8f3-1e0740610ed8 req-4a317d52-513e-4ed4-a141-a6209fbe40d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058401 Apr 19 03:38:41.814999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 45/87] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:38:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:41.876945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8e76a22d-7dc4-4a62-a267-612a0ae9fe10 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:41.888274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ea570637-3139-43de-949d-89f2617efb23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:41.889051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ea570637-3139-43de-949d-89f2617efb23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:41.898450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8e76a22d-7dc4-4a62-a267-612a0ae9fe10 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.331967 Apr 19 03:38:41.899281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea570637-3139-43de-949d-89f2617efb23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:41.899388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 43/88] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:41 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:41.899621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea570637-3139-43de-949d-89f2617efb23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:41.900741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea570637-3139-43de-949d-89f2617efb23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:41.901238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea570637-3139-43de-949d-89f2617efb23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:42.029698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea570637-3139-43de-949d-89f2617efb23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:42.040727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ea570637-3139-43de-949d-89f2617efb23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1295 microversion: 2.1 time: 0.155160 Apr 19 03:38:42.040727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 46/89] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:41 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1295 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:42.582137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-67ef4c5f-ea36-4345-9e56-b5bf87be867b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:42.582831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-67ef4c5f-ea36-4345-9e56-b5bf87be867b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:42.590829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67ef4c5f-ea36-4345-9e56-b5bf87be867b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:42.591449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67ef4c5f-ea36-4345-9e56-b5bf87be867b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:42.592277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67ef4c5f-ea36-4345-9e56-b5bf87be867b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:42.592759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67ef4c5f-ea36-4345-9e56-b5bf87be867b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:42.771808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3a0765f3-56d0-4874-a414-44d20b475b54 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:42.772476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3a0765f3-56d0-4874-a414-44d20b475b54 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:42.781146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a0765f3-56d0-4874-a414-44d20b475b54 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:42.781661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a0765f3-56d0-4874-a414-44d20b475b54 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:42.782555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a0765f3-56d0-4874-a414-44d20b475b54 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:42.783046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a0765f3-56d0-4874-a414-44d20b475b54 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:42.865755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-67ef4c5f-ea36-4345-9e56-b5bf87be867b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:42.874575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-67ef4c5f-ea36-4345-9e56-b5bf87be867b tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.296538 Apr 19 03:38:42.875228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 44/90] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:42 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:42.916413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-35a998d6-aff2-45bf-8806-1b82a257433d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:42.917073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-35a998d6-aff2-45bf-8806-1b82a257433d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:42.924713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35a998d6-aff2-45bf-8806-1b82a257433d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:42.925213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35a998d6-aff2-45bf-8806-1b82a257433d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:42.926037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35a998d6-aff2-45bf-8806-1b82a257433d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:42.926519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35a998d6-aff2-45bf-8806-1b82a257433d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:42.993920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3a0765f3-56d0-4874-a414-44d20b475b54 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:43.002936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3a0765f3-56d0-4874-a414-44d20b475b54 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.235288 Apr 19 03:38:43.003602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 47/91] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:42 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:43.057552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b9f1de66-a6f1-476c-ad4b-870ecb281f3c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:43.058344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b9f1de66-a6f1-476c-ad4b-870ecb281f3c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:43.066646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9f1de66-a6f1-476c-ad4b-870ecb281f3c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:43.067096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9f1de66-a6f1-476c-ad4b-870ecb281f3c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:43.067996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9f1de66-a6f1-476c-ad4b-870ecb281f3c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:43.068484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9f1de66-a6f1-476c-ad4b-870ecb281f3c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:43.136689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-35a998d6-aff2-45bf-8806-1b82a257433d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:43.146080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-35a998d6-aff2-45bf-8806-1b82a257433d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.233584 Apr 19 03:38:43.146704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 45/92] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:42 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:43.381919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b9f1de66-a6f1-476c-ad4b-870ecb281f3c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:43.392377 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b9f1de66-a6f1-476c-ad4b-870ecb281f3c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1295 microversion: 2.1 time: 0.338851 Apr 19 03:38:43.393069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 48/93] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:43 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1295 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:43.892399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-edb0e022-8125-4ffd-878c-25d8d8479334 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:43.893002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-edb0e022-8125-4ffd-878c-25d8d8479334 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:43.900775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-edb0e022-8125-4ffd-878c-25d8d8479334 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:43.901270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-edb0e022-8125-4ffd-878c-25d8d8479334 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:43.902089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-edb0e022-8125-4ffd-878c-25d8d8479334 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:43.902569 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-edb0e022-8125-4ffd-878c-25d8d8479334 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:44.021176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-98bb6b26-f57d-48ff-94dc-c5a163a3a6dc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:44.021845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-98bb6b26-f57d-48ff-94dc-c5a163a3a6dc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:44.029949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98bb6b26-f57d-48ff-94dc-c5a163a3a6dc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:44.030962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98bb6b26-f57d-48ff-94dc-c5a163a3a6dc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:44.031857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98bb6b26-f57d-48ff-94dc-c5a163a3a6dc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:44.032352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98bb6b26-f57d-48ff-94dc-c5a163a3a6dc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:44.116798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-edb0e022-8125-4ffd-878c-25d8d8479334 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:44.125746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-edb0e022-8125-4ffd-878c-25d8d8479334 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.237455 Apr 19 03:38:44.126367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 46/94] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:43 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:44.164016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9f1a0248-7a44-4240-ab27-672d2c89204e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:44.164757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9f1a0248-7a44-4240-ab27-672d2c89204e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:44.173177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9f1a0248-7a44-4240-ab27-672d2c89204e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:44.173685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9f1a0248-7a44-4240-ab27-672d2c89204e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:44.174523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9f1a0248-7a44-4240-ab27-672d2c89204e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:44.175046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9f1a0248-7a44-4240-ab27-672d2c89204e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:44.242591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-98bb6b26-f57d-48ff-94dc-c5a163a3a6dc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:44.251456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-98bb6b26-f57d-48ff-94dc-c5a163a3a6dc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.234422 Apr 19 03:38:44.252084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 49/95] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:44 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:44.412095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-20b3e513-0a68-4e99-9694-2ab3765f25ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:44.422521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-20b3e513-0a68-4e99-9694-2ab3765f25ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:44.450832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20b3e513-0a68-4e99-9694-2ab3765f25ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:44.451598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20b3e513-0a68-4e99-9694-2ab3765f25ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:44.454639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20b3e513-0a68-4e99-9694-2ab3765f25ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:44.457309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20b3e513-0a68-4e99-9694-2ab3765f25ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:44.516176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9f1a0248-7a44-4240-ab27-672d2c89204e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:44.527690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9f1a0248-7a44-4240-ab27-672d2c89204e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.367685 Apr 19 03:38:44.538825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 47/96] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:44 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:44.732560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20b3e513-0a68-4e99-9694-2ab3765f25ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:44.747619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-20b3e513-0a68-4e99-9694-2ab3765f25ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1295 microversion: 2.1 time: 0.336161 Apr 19 03:38:44.750551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 50/97] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:44 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1295 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:45.143750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bae45531-9767-4545-a28a-9781e4550046 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:45.144467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bae45531-9767-4545-a28a-9781e4550046 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:45.152268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bae45531-9767-4545-a28a-9781e4550046 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:45.152779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bae45531-9767-4545-a28a-9781e4550046 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:45.153620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bae45531-9767-4545-a28a-9781e4550046 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:45.154116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bae45531-9767-4545-a28a-9781e4550046 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:45.271021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4ba09693-7ced-4179-b769-acbdfb142706 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:45.272007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4ba09693-7ced-4179-b769-acbdfb142706 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:45.282262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ba09693-7ced-4179-b769-acbdfb142706 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:45.283837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ba09693-7ced-4179-b769-acbdfb142706 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:45.284986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ba09693-7ced-4179-b769-acbdfb142706 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:45.285181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ba09693-7ced-4179-b769-acbdfb142706 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:45.383752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bae45531-9767-4545-a28a-9781e4550046 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:45.393426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bae45531-9767-4545-a28a-9781e4550046 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.253827 Apr 19 03:38:45.394245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 48/98] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:45 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:45.514268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4ba09693-7ced-4179-b769-acbdfb142706 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:45.523182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4ba09693-7ced-4179-b769-acbdfb142706 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.257879 Apr 19 03:38:45.523788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 51/99] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:45 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:45.546684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-53d5a884-dbd4-4d7a-b681-a3a80ae83090 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:45.547665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-53d5a884-dbd4-4d7a-b681-a3a80ae83090 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:45.556106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53d5a884-dbd4-4d7a-b681-a3a80ae83090 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:45.556612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53d5a884-dbd4-4d7a-b681-a3a80ae83090 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:45.557452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53d5a884-dbd4-4d7a-b681-a3a80ae83090 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:45.557941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53d5a884-dbd4-4d7a-b681-a3a80ae83090 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:45.766559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-20ea5d14-483e-4c83-bee4-6adac1440a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:45.767356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-20ea5d14-483e-4c83-bee4-6adac1440a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:45.769759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-53d5a884-dbd4-4d7a-b681-a3a80ae83090 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:45.775298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20ea5d14-483e-4c83-bee4-6adac1440a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:45.775801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20ea5d14-483e-4c83-bee4-6adac1440a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:45.776631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20ea5d14-483e-4c83-bee4-6adac1440a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:45.777115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20ea5d14-483e-4c83-bee4-6adac1440a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:45.778707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-53d5a884-dbd4-4d7a-b681-a3a80ae83090 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.236745 Apr 19 03:38:45.779356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 49/100] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:45 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:46.032527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20ea5d14-483e-4c83-bee4-6adac1440a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:46.041163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-20ea5d14-483e-4c83-bee4-6adac1440a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.279202 Apr 19 03:38:46.041831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 52/101] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:45 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:46.411631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c0f729e4-3cee-410d-90c7-3f3e7274b91d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:46.412300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c0f729e4-3cee-410d-90c7-3f3e7274b91d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:46.420398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0f729e4-3cee-410d-90c7-3f3e7274b91d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:46.421408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0f729e4-3cee-410d-90c7-3f3e7274b91d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:46.422228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0f729e4-3cee-410d-90c7-3f3e7274b91d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:46.422711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0f729e4-3cee-410d-90c7-3f3e7274b91d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:46.541144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c06b0240-bdeb-4805-b262-6e1ff303b757 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:46.541807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c06b0240-bdeb-4805-b262-6e1ff303b757 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:46.567845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c06b0240-bdeb-4805-b262-6e1ff303b757 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:46.568479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c06b0240-bdeb-4805-b262-6e1ff303b757 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:46.569477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c06b0240-bdeb-4805-b262-6e1ff303b757 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:46.570107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c06b0240-bdeb-4805-b262-6e1ff303b757 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:46.638516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c0f729e4-3cee-410d-90c7-3f3e7274b91d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:46.647613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c0f729e4-3cee-410d-90c7-3f3e7274b91d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.240052 Apr 19 03:38:46.648245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 50/102] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:46 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:46.783874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c06b0240-bdeb-4805-b262-6e1ff303b757 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:46.794431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c06b0240-bdeb-4805-b262-6e1ff303b757 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.257150 Apr 19 03:38:46.799718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-328003fa-e7ff-4e7a-b570-9e28c3f3a052 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:46.800552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-328003fa-e7ff-4e7a-b570-9e28c3f3a052 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:46.805383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 53/103] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:46 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:46.808826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-328003fa-e7ff-4e7a-b570-9e28c3f3a052 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:46.809321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-328003fa-e7ff-4e7a-b570-9e28c3f3a052 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:46.810149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-328003fa-e7ff-4e7a-b570-9e28c3f3a052 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:46.810632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-328003fa-e7ff-4e7a-b570-9e28c3f3a052 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:47.023675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-328003fa-e7ff-4e7a-b570-9e28c3f3a052 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:47.032868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-328003fa-e7ff-4e7a-b570-9e28c3f3a052 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.238224 Apr 19 03:38:47.033481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 51/104] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:46 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:47.057984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-040a2375-a550-4be7-810f-555b78fdd8e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:47.058650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-040a2375-a550-4be7-810f-555b78fdd8e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:47.066393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-040a2375-a550-4be7-810f-555b78fdd8e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:47.066900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-040a2375-a550-4be7-810f-555b78fdd8e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:47.067751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-040a2375-a550-4be7-810f-555b78fdd8e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:47.068239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-040a2375-a550-4be7-810f-555b78fdd8e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:47.276588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-040a2375-a550-4be7-810f-555b78fdd8e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:47.286046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-040a2375-a550-4be7-810f-555b78fdd8e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.232074 Apr 19 03:38:47.286705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 54/105] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:47 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:47.665767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c96bc70f-9994-46e6-b23a-c2fc28704cf5 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:47.666424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c96bc70f-9994-46e6-b23a-c2fc28704cf5 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:47.674226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c96bc70f-9994-46e6-b23a-c2fc28704cf5 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:47.674734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c96bc70f-9994-46e6-b23a-c2fc28704cf5 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:47.675585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c96bc70f-9994-46e6-b23a-c2fc28704cf5 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:47.676075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c96bc70f-9994-46e6-b23a-c2fc28704cf5 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:47.813555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-936dae58-49f4-4c7b-bd66-4e9b0a1d3ceb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:47.814149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-936dae58-49f4-4c7b-bd66-4e9b0a1d3ceb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:47.822142 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-936dae58-49f4-4c7b-bd66-4e9b0a1d3ceb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:47.822650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-936dae58-49f4-4c7b-bd66-4e9b0a1d3ceb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:47.823535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-936dae58-49f4-4c7b-bd66-4e9b0a1d3ceb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:47.824030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-936dae58-49f4-4c7b-bd66-4e9b0a1d3ceb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:47.921768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c96bc70f-9994-46e6-b23a-c2fc28704cf5 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:47.931961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c96bc70f-9994-46e6-b23a-c2fc28704cf5 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1315 microversion: 2.1 time: 0.270465 Apr 19 03:38:47.933995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 52/106] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:47 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:48.050601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cef04e28-1563-4dde-8ab8-7e772f63308b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:48.051389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cef04e28-1563-4dde-8ab8-7e772f63308b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:48.059690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cef04e28-1563-4dde-8ab8-7e772f63308b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:48.060186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cef04e28-1563-4dde-8ab8-7e772f63308b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:48.061024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cef04e28-1563-4dde-8ab8-7e772f63308b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:48.062342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cef04e28-1563-4dde-8ab8-7e772f63308b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:48.218553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-936dae58-49f4-4c7b-bd66-4e9b0a1d3ceb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:48.229370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-936dae58-49f4-4c7b-bd66-4e9b0a1d3ceb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.420239 Apr 19 03:38:48.230210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 55/107] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:47 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:48.286292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cef04e28-1563-4dde-8ab8-7e772f63308b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:48.295533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cef04e28-1563-4dde-8ab8-7e772f63308b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1318 microversion: 2.1 time: 0.249442 Apr 19 03:38:48.296715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 53/108] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:48 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:48.304049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-68136885-cdea-41aa-8a48-16e9973756eb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:48.305004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-68136885-cdea-41aa-8a48-16e9973756eb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:48.315056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68136885-cdea-41aa-8a48-16e9973756eb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:48.315859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68136885-cdea-41aa-8a48-16e9973756eb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:48.316707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68136885-cdea-41aa-8a48-16e9973756eb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:48.317419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68136885-cdea-41aa-8a48-16e9973756eb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:48.866892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-68136885-cdea-41aa-8a48-16e9973756eb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:48.877546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-68136885-cdea-41aa-8a48-16e9973756eb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.577533 Apr 19 03:38:48.879431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 56/109] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:48 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:48.951133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-492245e2-63b6-4f7b-b0e2-16b0edaa6336 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:48.951824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-492245e2-63b6-4f7b-b0e2-16b0edaa6336 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:48.960296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-492245e2-63b6-4f7b-b0e2-16b0edaa6336 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:48.960953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-492245e2-63b6-4f7b-b0e2-16b0edaa6336 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:48.961799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-492245e2-63b6-4f7b-b0e2-16b0edaa6336 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:48.962287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-492245e2-63b6-4f7b-b0e2-16b0edaa6336 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:49.006315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-41f5ef84-0160-4fe6-8a46-735f598aaa90 req-f5be8dd9-fc57-49fc-93ea-abf5ad1a79fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8953516a-dcec-4e76-92a9-9a8f25e24014", "tag": "ecbdac77-18ba-4113-9f8c-ba2c61c4047b"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:49.010152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:38:49.010152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:38:49.021974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-41f5ef84-0160-4fe6-8a46-735f598aaa90 req-f5be8dd9-fc57-49fc-93ea-abf5ad1a79fe service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:49.022693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-41f5ef84-0160-4fe6-8a46-735f598aaa90 req-f5be8dd9-fc57-49fc-93ea-abf5ad1a79fe service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:49.047766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-41f5ef84-0160-4fe6-8a46-735f598aaa90 req-f5be8dd9-fc57-49fc-93ea-abf5ad1a79fe service nova] Creating event network-changed:ecbdac77-18ba-4113-9f8c-ba2c61c4047b for instance 8953516a-dcec-4e76-92a9-9a8f25e24014 on hv-cinder-78605 Apr 19 03:38:49.054669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-41f5ef84-0160-4fe6-8a46-735f598aaa90 req-f5be8dd9-fc57-49fc-93ea-abf5ad1a79fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052526 Apr 19 03:38:49.056013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 57/110] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:38:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:49.234346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-492245e2-63b6-4f7b-b0e2-16b0edaa6336 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:49.244661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-492245e2-63b6-4f7b-b0e2-16b0edaa6336 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1502 microversion: 2.1 time: 0.297372 Apr 19 03:38:49.245317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 54/111] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:48 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:49.250600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1328ed74-0a47-4021-8ba1-95d51981d24a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:49.251541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1328ed74-0a47-4021-8ba1-95d51981d24a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:49.260711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1328ed74-0a47-4021-8ba1-95d51981d24a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:49.261543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1328ed74-0a47-4021-8ba1-95d51981d24a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:49.262429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1328ed74-0a47-4021-8ba1-95d51981d24a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:49.262929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1328ed74-0a47-4021-8ba1-95d51981d24a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:49.315477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fe91e9c8-6080-46f2-aec8-3cf4d0a53467 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:49.316398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fe91e9c8-6080-46f2-aec8-3cf4d0a53467 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:49.324757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe91e9c8-6080-46f2-aec8-3cf4d0a53467 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:49.325269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe91e9c8-6080-46f2-aec8-3cf4d0a53467 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:49.326117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe91e9c8-6080-46f2-aec8-3cf4d0a53467 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:49.326585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe91e9c8-6080-46f2-aec8-3cf4d0a53467 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:49.489477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1328ed74-0a47-4021-8ba1-95d51981d24a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:49.501165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1328ed74-0a47-4021-8ba1-95d51981d24a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.256382 Apr 19 03:38:49.502043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 58/112] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:49 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:49.589118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fe91e9c8-6080-46f2-aec8-3cf4d0a53467 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:49.609436 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fe91e9c8-6080-46f2-aec8-3cf4d0a53467 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1507 microversion: 2.1 time: 0.291117 Apr 19 03:38:49.610530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 55/113] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:49 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1507 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:49.896208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-921ea823-e995-4dba-8439-dcc6cf4a234e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:49.897588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-921ea823-e995-4dba-8439-dcc6cf4a234e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:49.906479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-921ea823-e995-4dba-8439-dcc6cf4a234e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:49.907267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-921ea823-e995-4dba-8439-dcc6cf4a234e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:49.908306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-921ea823-e995-4dba-8439-dcc6cf4a234e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:49.908982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-921ea823-e995-4dba-8439-dcc6cf4a234e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:50.157516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-921ea823-e995-4dba-8439-dcc6cf4a234e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:50.166408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-921ea823-e995-4dba-8439-dcc6cf4a234e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.274423 Apr 19 03:38:50.167028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 59/114] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:49 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:50.518878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6cb83e6f-74ac-466e-935c-fa08e28ac8ef tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:50.519601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6cb83e6f-74ac-466e-935c-fa08e28ac8ef tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:50.527707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cb83e6f-74ac-466e-935c-fa08e28ac8ef tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:50.528218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cb83e6f-74ac-466e-935c-fa08e28ac8ef tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:50.529057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cb83e6f-74ac-466e-935c-fa08e28ac8ef tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:50.529546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cb83e6f-74ac-466e-935c-fa08e28ac8ef tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:50.762241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6cb83e6f-74ac-466e-935c-fa08e28ac8ef tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:50.771662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6cb83e6f-74ac-466e-935c-fa08e28ac8ef tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.257074 Apr 19 03:38:50.772290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 56/115] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:50 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:51.184926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a8b23d1a-d5a8-4446-af8b-8505021ee6d7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:51.185593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a8b23d1a-d5a8-4446-af8b-8505021ee6d7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:51.196490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a8b23d1a-d5a8-4446-af8b-8505021ee6d7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:51.197616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a8b23d1a-d5a8-4446-af8b-8505021ee6d7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:51.199203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-aa7437e3-d856-4182-9cb4-0a721d73abf9 req-7dd269b6-de9f-440c-8c11-5dc9a217e284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22", "name": "network-vif-plugged", "status": "completed", "tag": "f3d9b8ab-bbd3-4640-81fd-67706cd12ecc"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:51.199398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a8b23d1a-d5a8-4446-af8b-8505021ee6d7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:51.200933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a8b23d1a-d5a8-4446-af8b-8505021ee6d7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:51.201395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:38:51.201395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:38:51.215296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-aa7437e3-d856-4182-9cb4-0a721d73abf9 req-7dd269b6-de9f-440c-8c11-5dc9a217e284 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:51.216011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-aa7437e3-d856-4182-9cb4-0a721d73abf9 req-7dd269b6-de9f-440c-8c11-5dc9a217e284 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:51.244843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-aa7437e3-d856-4182-9cb4-0a721d73abf9 req-7dd269b6-de9f-440c-8c11-5dc9a217e284 service nova] Creating event network-vif-plugged:f3d9b8ab-bbd3-4640-81fd-67706cd12ecc for instance 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 on hv-cinder-78605 Apr 19 03:38:51.250985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-aa7437e3-d856-4182-9cb4-0a721d73abf9 req-7dd269b6-de9f-440c-8c11-5dc9a217e284 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055906 Apr 19 03:38:51.252105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 57/116] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:38:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:51.495303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a8b23d1a-d5a8-4446-af8b-8505021ee6d7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:51.508955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a8b23d1a-d5a8-4446-af8b-8505021ee6d7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.327443 Apr 19 03:38:51.518897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 60/117] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:51 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:51.790131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4ffa475d-0b28-4e06-a12c-de84bfdc756a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:51.790915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4ffa475d-0b28-4e06-a12c-de84bfdc756a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:51.798948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ffa475d-0b28-4e06-a12c-de84bfdc756a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:51.799488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ffa475d-0b28-4e06-a12c-de84bfdc756a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:51.800326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ffa475d-0b28-4e06-a12c-de84bfdc756a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:51.800818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ffa475d-0b28-4e06-a12c-de84bfdc756a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:52.026909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4ffa475d-0b28-4e06-a12c-de84bfdc756a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:52.037231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4ffa475d-0b28-4e06-a12c-de84bfdc756a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.251529 Apr 19 03:38:52.053188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 58/118] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:51 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:52.526125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f184811f-98d0-49cb-a08a-8b9037dde734 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:52.526778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f184811f-98d0-49cb-a08a-8b9037dde734 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:52.535021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f184811f-98d0-49cb-a08a-8b9037dde734 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:52.535559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f184811f-98d0-49cb-a08a-8b9037dde734 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:52.536400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f184811f-98d0-49cb-a08a-8b9037dde734 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:52.536895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f184811f-98d0-49cb-a08a-8b9037dde734 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:52.702226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0373dfd7-0df8-4995-a518-a7d7d0f94e8d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3badd6a8-41ac-43ea-9736-b322298d7571"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:52.706494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0373dfd7-0df8-4995-a518-a7d7d0f94e8d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:52.712424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0373dfd7-0df8-4995-a518-a7d7d0f94e8d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:52.713139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0373dfd7-0df8-4995-a518-a7d7d0f94e8d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:52.714181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0373dfd7-0df8-4995-a518-a7d7d0f94e8d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:52.714987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0373dfd7-0df8-4995-a518-a7d7d0f94e8d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:52.851672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f184811f-98d0-49cb-a08a-8b9037dde734 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:52.864557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f184811f-98d0-49cb-a08a-8b9037dde734 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.342458 Apr 19 03:38:52.867672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 61/119] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:52 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:53.055373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5b5c6261-a7d1-414b-a3d9-e33dc2a4af60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:53.055640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5b5c6261-a7d1-414b-a3d9-e33dc2a4af60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:53.064419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5b5c6261-a7d1-414b-a3d9-e33dc2a4af60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:53.065022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5b5c6261-a7d1-414b-a3d9-e33dc2a4af60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:53.065949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5b5c6261-a7d1-414b-a3d9-e33dc2a4af60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:53.066529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5b5c6261-a7d1-414b-a3d9-e33dc2a4af60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:53.476637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5b5c6261-a7d1-414b-a3d9-e33dc2a4af60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:53.487802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5b5c6261-a7d1-414b-a3d9-e33dc2a4af60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.437598 Apr 19 03:38:53.489774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 62/120] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:53 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:53.496896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-8a22f562-27e4-4991-b100-86c35fc2d41f req-dddc2011-1d98-422a-8d6f-a88f62e5e518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a261074-36d1-43c7-aa9f-3b01ef9b22de", "name": "network-vif-plugged", "status": "completed", "tag": "60e9cad0-05d1-41b7-9493-d8716b118842"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:53.499305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:38:53.499305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:38:53.509224 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-8a22f562-27e4-4991-b100-86c35fc2d41f req-dddc2011-1d98-422a-8d6f-a88f62e5e518 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:53.510245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-8a22f562-27e4-4991-b100-86c35fc2d41f req-dddc2011-1d98-422a-8d6f-a88f62e5e518 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:53.532409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-8a22f562-27e4-4991-b100-86c35fc2d41f req-dddc2011-1d98-422a-8d6f-a88f62e5e518 service nova] Creating event network-vif-plugged:60e9cad0-05d1-41b7-9493-d8716b118842 for instance 6a261074-36d1-43c7-aa9f-3b01ef9b22de on hv-cinder-78605 Apr 19 03:38:53.538928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-8a22f562-27e4-4991-b100-86c35fc2d41f req-dddc2011-1d98-422a-8d6f-a88f62e5e518 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047241 Apr 19 03:38:53.551497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0373dfd7-0df8-4995-a518-a7d7d0f94e8d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "POST /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845998 Apr 19 03:38:53.551497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 59/121] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:38:52 2021] POST /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:38:53.551687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 63/122] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:38:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:53.688531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3a1ba660-eb7f-4ba5-a923-33d5036ca028 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dc45f3e-559c-46ea-9060-d339a0856a8e"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:53.690111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3a1ba660-eb7f-4ba5-a923-33d5036ca028 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:53.699423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a1ba660-eb7f-4ba5-a923-33d5036ca028 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:53.700180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a1ba660-eb7f-4ba5-a923-33d5036ca028 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:53.701185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a1ba660-eb7f-4ba5-a923-33d5036ca028 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:53.702375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a1ba660-eb7f-4ba5-a923-33d5036ca028 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:53.883829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5c644dc9-0d93-4b86-b182-4be246d38f95 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:53.888683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5c644dc9-0d93-4b86-b182-4be246d38f95 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:53.894045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c644dc9-0d93-4b86-b182-4be246d38f95 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:53.894773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c644dc9-0d93-4b86-b182-4be246d38f95 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:53.895841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c644dc9-0d93-4b86-b182-4be246d38f95 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:53.897168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c644dc9-0d93-4b86-b182-4be246d38f95 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:54.227774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5c644dc9-0d93-4b86-b182-4be246d38f95 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:54.249959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5c644dc9-0d93-4b86-b182-4be246d38f95 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.371345 Apr 19 03:38:54.250618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 64/123] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:53 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:54.506237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6ce0d2b2-07f9-4b1e-abe5-208822d63809 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:54.506971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6ce0d2b2-07f9-4b1e-abe5-208822d63809 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:54.515335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ce0d2b2-07f9-4b1e-abe5-208822d63809 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:54.515837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ce0d2b2-07f9-4b1e-abe5-208822d63809 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:54.516646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ce0d2b2-07f9-4b1e-abe5-208822d63809 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:54.517173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ce0d2b2-07f9-4b1e-abe5-208822d63809 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:54.764989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3a1ba660-eb7f-4ba5-a923-33d5036ca028 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "POST /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.081136 Apr 19 03:38:54.771005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 60/124] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:38:53 2021] POST /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783/os-volume_attachments => generated 194 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:54.824188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6ce0d2b2-07f9-4b1e-abe5-208822d63809 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:54.833852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6ce0d2b2-07f9-4b1e-abe5-208822d63809 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1320 microversion: 2.1 time: 0.331875 Apr 19 03:38:54.837263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 65/125] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:54 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:38:55.269726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-476af0c6-fea3-4069-b35e-a6349fc2535d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:55.271420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-476af0c6-fea3-4069-b35e-a6349fc2535d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:55.291791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-476af0c6-fea3-4069-b35e-a6349fc2535d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:55.292635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-476af0c6-fea3-4069-b35e-a6349fc2535d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:55.293659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-476af0c6-fea3-4069-b35e-a6349fc2535d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:55.294337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-476af0c6-fea3-4069-b35e-a6349fc2535d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:55.560502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-476af0c6-fea3-4069-b35e-a6349fc2535d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:55.569696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-476af0c6-fea3-4069-b35e-a6349fc2535d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.305965 Apr 19 03:38:55.570312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 61/126] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:55 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:55.854588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f862fa63-f4f2-4aaa-a0aa-102b161e5173 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:55.855383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f862fa63-f4f2-4aaa-a0aa-102b161e5173 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:55.863785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f862fa63-f4f2-4aaa-a0aa-102b161e5173 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:55.864617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f862fa63-f4f2-4aaa-a0aa-102b161e5173 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:55.866445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f862fa63-f4f2-4aaa-a0aa-102b161e5173 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:55.866445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f862fa63-f4f2-4aaa-a0aa-102b161e5173 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:56.112055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f862fa63-f4f2-4aaa-a0aa-102b161e5173 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:56.124139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f862fa63-f4f2-4aaa-a0aa-102b161e5173 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1513 microversion: 2.1 time: 0.273327 Apr 19 03:38:56.136351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 66/127] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:55 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:56.143974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3ad7aafa-106b-4954-9f60-265edc93c2cd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:56.145401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3ad7aafa-106b-4954-9f60-265edc93c2cd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:56.154691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ad7aafa-106b-4954-9f60-265edc93c2cd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:56.155470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ad7aafa-106b-4954-9f60-265edc93c2cd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:56.156482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ad7aafa-106b-4954-9f60-265edc93c2cd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:56.157272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ad7aafa-106b-4954-9f60-265edc93c2cd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:56.229465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-3ad7aafa-106b-4954-9f60-265edc93c2cd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lazy-loading 'flavor' on Instance uuid 6a261074-36d1-43c7-aa9f-3b01ef9b22de {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:38:56.534408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3ad7aafa-106b-4954-9f60-265edc93c2cd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "POST /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de/action" status: 200 len: 32 microversion: 2.1 time: 0.395474 Apr 19 03:38:56.535844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 62/128] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:38:56 2021] POST /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de/action => generated 32 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:38:56.545107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a059fb89-f1af-48d6-b0b3-66f64ecec112 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:56.546326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a059fb89-f1af-48d6-b0b3-66f64ecec112 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:56.567101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a059fb89-f1af-48d6-b0b3-66f64ecec112 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:56.567822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a059fb89-f1af-48d6-b0b3-66f64ecec112 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:56.568902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a059fb89-f1af-48d6-b0b3-66f64ecec112 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:56.569545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a059fb89-f1af-48d6-b0b3-66f64ecec112 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:56.598134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ebe17359-7353-4b80-8280-acd1a42dca5b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:56.598924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ebe17359-7353-4b80-8280-acd1a42dca5b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:56.613214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ebe17359-7353-4b80-8280-acd1a42dca5b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:56.617518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ebe17359-7353-4b80-8280-acd1a42dca5b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:56.617518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ebe17359-7353-4b80-8280-acd1a42dca5b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:56.617518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ebe17359-7353-4b80-8280-acd1a42dca5b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:56.865495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ebe17359-7353-4b80-8280-acd1a42dca5b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:56.876526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ebe17359-7353-4b80-8280-acd1a42dca5b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.292069 Apr 19 03:38:56.877159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 63/129] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:56 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:57.001731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a059fb89-f1af-48d6-b0b3-66f64ecec112 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:57.010776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a059fb89-f1af-48d6-b0b3-66f64ecec112 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.469867 Apr 19 03:38:57.011435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 67/130] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:56 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:57.896401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7de6386f-0932-450d-be22-40a2935f221f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:57.897190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7de6386f-0932-450d-be22-40a2935f221f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:57.905357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7de6386f-0932-450d-be22-40a2935f221f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:57.905950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7de6386f-0932-450d-be22-40a2935f221f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:57.906850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7de6386f-0932-450d-be22-40a2935f221f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:57.907449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7de6386f-0932-450d-be22-40a2935f221f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:58.036257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0b1cdd94-1b15-4b1b-b016-12a05481a008 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:58.036943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0b1cdd94-1b15-4b1b-b016-12a05481a008 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:58.052175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b1cdd94-1b15-4b1b-b016-12a05481a008 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:58.055353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b1cdd94-1b15-4b1b-b016-12a05481a008 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:58.055353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b1cdd94-1b15-4b1b-b016-12a05481a008 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:58.055353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b1cdd94-1b15-4b1b-b016-12a05481a008 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:58.187576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7de6386f-0932-450d-be22-40a2935f221f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:58.197590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7de6386f-0932-450d-be22-40a2935f221f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.306047 Apr 19 03:38:58.198531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 64/131] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:57 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:58.361574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0b1cdd94-1b15-4b1b-b016-12a05481a008 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:58.371650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0b1cdd94-1b15-4b1b-b016-12a05481a008 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.345645 Apr 19 03:38:58.372456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 68/132] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:58 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:58.384147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-d7c4809a-fcf9-46ea-98ab-c307ea7899b1 req-1cc46e26-2c9c-44a5-834b-1b9bebe23c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8953516a-dcec-4e76-92a9-9a8f25e24014", "name": "network-vif-plugged", "status": "completed", "tag": "ecbdac77-18ba-4113-9f8c-ba2c61c4047b"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:38:58.385874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:38:58.385874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:38:58.395072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-d7c4809a-fcf9-46ea-98ab-c307ea7899b1 req-1cc46e26-2c9c-44a5-834b-1b9bebe23c63 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:58.400987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-d7c4809a-fcf9-46ea-98ab-c307ea7899b1 req-1cc46e26-2c9c-44a5-834b-1b9bebe23c63 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:58.415011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-d7c4809a-fcf9-46ea-98ab-c307ea7899b1 req-1cc46e26-2c9c-44a5-834b-1b9bebe23c63 service nova] Creating event network-vif-plugged:ecbdac77-18ba-4113-9f8c-ba2c61c4047b for instance 8953516a-dcec-4e76-92a9-9a8f25e24014 on hv-cinder-78605 Apr 19 03:38:58.421189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-d7c4809a-fcf9-46ea-98ab-c307ea7899b1 req-1cc46e26-2c9c-44a5-834b-1b9bebe23c63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042799 Apr 19 03:38:58.421838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 65/133] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:38:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:38:59.219426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-38a93cb7-cd1d-4d53-ab3e-49c6fee5fa61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:59.220093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-38a93cb7-cd1d-4d53-ab3e-49c6fee5fa61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:59.227790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38a93cb7-cd1d-4d53-ab3e-49c6fee5fa61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:59.228291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38a93cb7-cd1d-4d53-ab3e-49c6fee5fa61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:59.229105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38a93cb7-cd1d-4d53-ab3e-49c6fee5fa61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:59.229595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38a93cb7-cd1d-4d53-ab3e-49c6fee5fa61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:59.391077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-171ce938-1d62-43ab-98d3-407f4c49385d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:38:59.394333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-171ce938-1d62-43ab-98d3-407f4c49385d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:38:59.404504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-171ce938-1d62-43ab-98d3-407f4c49385d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:59.405616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-171ce938-1d62-43ab-98d3-407f4c49385d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:59.406609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-171ce938-1d62-43ab-98d3-407f4c49385d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:38:59.407272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-171ce938-1d62-43ab-98d3-407f4c49385d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:38:59.470499 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-38a93cb7-cd1d-4d53-ab3e-49c6fee5fa61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:59.479594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-38a93cb7-cd1d-4d53-ab3e-49c6fee5fa61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1362 microversion: 2.1 time: 0.264230 Apr 19 03:38:59.480772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 69/134] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:59 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:38:59.725102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-171ce938-1d62-43ab-98d3-407f4c49385d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:38:59.734631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-171ce938-1d62-43ab-98d3-407f4c49385d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.348666 Apr 19 03:38:59.735525 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 66/135] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:38:59 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:00.498916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9d538cce-d65b-426e-8423-3adead17ad1e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:00.499738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9d538cce-d65b-426e-8423-3adead17ad1e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:00.507764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d538cce-d65b-426e-8423-3adead17ad1e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:00.508269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d538cce-d65b-426e-8423-3adead17ad1e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:00.509110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d538cce-d65b-426e-8423-3adead17ad1e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:00.509606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d538cce-d65b-426e-8423-3adead17ad1e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:00.755885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-88cef47e-5d5f-4c06-82cf-8c2ff76a08a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:00.756560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-88cef47e-5d5f-4c06-82cf-8c2ff76a08a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:00.765186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88cef47e-5d5f-4c06-82cf-8c2ff76a08a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:00.765964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88cef47e-5d5f-4c06-82cf-8c2ff76a08a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:00.767067 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88cef47e-5d5f-4c06-82cf-8c2ff76a08a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:00.767755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88cef47e-5d5f-4c06-82cf-8c2ff76a08a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:00.796751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9d538cce-d65b-426e-8423-3adead17ad1e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:00.808125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9d538cce-d65b-426e-8423-3adead17ad1e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1548 microversion: 2.1 time: 0.313062 Apr 19 03:39:00.823610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 70/136] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:00 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1548 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:00.830310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-def1ece8-282f-45bb-8798-3749a23c8552 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:00.831056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-def1ece8-282f-45bb-8798-3749a23c8552 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:00.840277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-def1ece8-282f-45bb-8798-3749a23c8552 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:00.841071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-def1ece8-282f-45bb-8798-3749a23c8552 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:00.842456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-def1ece8-282f-45bb-8798-3749a23c8552 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:00.843385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-def1ece8-282f-45bb-8798-3749a23c8552 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:01.086105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-def1ece8-282f-45bb-8798-3749a23c8552 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.260592 Apr 19 03:39:01.086987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 71/137] 10.222.0.25 () {58 vars in 1265 bytes} [Mon Apr 19 03:39:00 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/os-interface => generated 285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:39:01.136468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-88cef47e-5d5f-4c06-82cf-8c2ff76a08a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:01.152063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-88cef47e-5d5f-4c06-82cf-8c2ff76a08a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.402462 Apr 19 03:39:01.157107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 67/138] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:00 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:02.170021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c4afdbe0-9b6f-4ec6-8097-a5e84e8f9dc9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:02.171254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c4afdbe0-9b6f-4ec6-8097-a5e84e8f9dc9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:02.181552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c4afdbe0-9b6f-4ec6-8097-a5e84e8f9dc9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:02.182055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c4afdbe0-9b6f-4ec6-8097-a5e84e8f9dc9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:02.182875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c4afdbe0-9b6f-4ec6-8097-a5e84e8f9dc9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:02.183393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c4afdbe0-9b6f-4ec6-8097-a5e84e8f9dc9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:02.731654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c4afdbe0-9b6f-4ec6-8097-a5e84e8f9dc9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:02.743308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c4afdbe0-9b6f-4ec6-8097-a5e84e8f9dc9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.576967 Apr 19 03:39:02.744389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 72/139] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:02 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:03.430243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-6f3634b0-3b3b-4241-8017-a59aaa34f58b req-b1f189cb-452c-4e0b-957e-369f11d497e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8953516a-dcec-4e76-92a9-9a8f25e24014", "tag": "ecbdac77-18ba-4113-9f8c-ba2c61c4047b"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:03.430752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1cd4887b-9e0e-4acf-9641-006be89ff227 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:03.431989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:39:03.431989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:39:03.432262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1cd4887b-9e0e-4acf-9641-006be89ff227 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:03.442439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cd4887b-9e0e-4acf-9641-006be89ff227 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:03.443137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cd4887b-9e0e-4acf-9641-006be89ff227 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:03.448655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-6f3634b0-3b3b-4241-8017-a59aaa34f58b req-b1f189cb-452c-4e0b-957e-369f11d497e8 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:03.449323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-6f3634b0-3b3b-4241-8017-a59aaa34f58b req-b1f189cb-452c-4e0b-957e-369f11d497e8 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:03.456330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cd4887b-9e0e-4acf-9641-006be89ff227 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:03.459238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cd4887b-9e0e-4acf-9641-006be89ff227 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:03.472005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-6f3634b0-3b3b-4241-8017-a59aaa34f58b req-b1f189cb-452c-4e0b-957e-369f11d497e8 service nova] Creating event network-changed:ecbdac77-18ba-4113-9f8c-ba2c61c4047b for instance 8953516a-dcec-4e76-92a9-9a8f25e24014 on hv-cinder-78605 Apr 19 03:39:03.477513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-6f3634b0-3b3b-4241-8017-a59aaa34f58b req-b1f189cb-452c-4e0b-957e-369f11d497e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050983 Apr 19 03:39:03.478205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 73/140] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:39:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:39:03.762057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1ab88062-e508-477f-bfe6-7e5f993bae1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:03.763308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1ab88062-e508-477f-bfe6-7e5f993bae1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:03.771845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ab88062-e508-477f-bfe6-7e5f993bae1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:03.772361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ab88062-e508-477f-bfe6-7e5f993bae1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:03.773850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ab88062-e508-477f-bfe6-7e5f993bae1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:03.774534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ab88062-e508-477f-bfe6-7e5f993bae1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:03.924892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1cd4887b-9e0e-4acf-9641-006be89ff227 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 14 microversion: 2.1 time: 0.499964 Apr 19 03:39:03.930196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 68/141] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:03 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 14 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:39:04.271060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1ab88062-e508-477f-bfe6-7e5f993bae1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:04.286118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1ab88062-e508-477f-bfe6-7e5f993bae1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.528260 Apr 19 03:39:04.287516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 74/142] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:03 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:04.938624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a7d1dcec-8b77-41eb-8b32-4447b25ad6c2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:04.940920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a7d1dcec-8b77-41eb-8b32-4447b25ad6c2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:04.966194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7d1dcec-8b77-41eb-8b32-4447b25ad6c2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:04.966721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7d1dcec-8b77-41eb-8b32-4447b25ad6c2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:04.968179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7d1dcec-8b77-41eb-8b32-4447b25ad6c2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:04.968669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7d1dcec-8b77-41eb-8b32-4447b25ad6c2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:05.090371 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a7d1dcec-8b77-41eb-8b32-4447b25ad6c2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 14 microversion: 2.1 time: 0.156343 Apr 19 03:39:05.091247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 69/143] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:04 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:39:05.313580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5b804e58-a6e2-4352-85f9-b4fa349794c2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:05.314395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5b804e58-a6e2-4352-85f9-b4fa349794c2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:05.326112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5b804e58-a6e2-4352-85f9-b4fa349794c2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:05.326112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5b804e58-a6e2-4352-85f9-b4fa349794c2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:05.328047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5b804e58-a6e2-4352-85f9-b4fa349794c2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:05.328632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5b804e58-a6e2-4352-85f9-b4fa349794c2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:05.597643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5b804e58-a6e2-4352-85f9-b4fa349794c2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:05.598673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5b804e58-a6e2-4352-85f9-b4fa349794c2 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.289751 Apr 19 03:39:05.598950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 75/144] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:05 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:05.749120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-354604809", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "networks": [{"uuid": "c6488502-d478-4c15-aad9-cec2dbbd6c1f"}]}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:05.923843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] validate_networks() for [('c6488502-d478-4c15-aad9-cec2dbbd6c1f', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:39:06.102645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cb25b695-ae01-48ad-838d-149b78e92acb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:06.103746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cb25b695-ae01-48ad-838d-149b78e92acb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:06.112884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb25b695-ae01-48ad-838d-149b78e92acb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:06.118370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb25b695-ae01-48ad-838d-149b78e92acb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:06.118370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb25b695-ae01-48ad-838d-149b78e92acb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:06.118370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb25b695-ae01-48ad-838d-149b78e92acb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:06.254935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cb25b695-ae01-48ad-838d-149b78e92acb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 14 microversion: 2.1 time: 0.156136 Apr 19 03:39:06.256016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 76/145] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:06 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 19 03:39:06.631013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3f5ce484-60d0-44a5-aef1-ae938d6dce06 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:06.632339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3f5ce484-60d0-44a5-aef1-ae938d6dce06 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:06.642581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f5ce484-60d0-44a5-aef1-ae938d6dce06 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:06.643649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f5ce484-60d0-44a5-aef1-ae938d6dce06 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:06.657720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f5ce484-60d0-44a5-aef1-ae938d6dce06 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:06.657720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f5ce484-60d0-44a5-aef1-ae938d6dce06 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:06.728664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:39:06.729267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:39:06.729879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:39:06.730424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:39:06.731082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:39:06.741388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:06.742141 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:06.743241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:06.743967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:06.768498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Getting quotas for project 3a4502ef85b348a384aa26343b925024. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:39:06.774343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Getting quotas for user 7230efa31a8f47ca95af1f576f73cd90 and project 3a4502ef85b348a384aa26343b925024. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:39:06.787811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:39:06.791375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:39:06.899066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ea804a35-d652-4009-814e-26c32b505652 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154585 Apr 19 03:39:06.900040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 70/146] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:39:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:39:06.909816 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3f5ce484-60d0-44a5-aef1-ae938d6dce06 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:06.911284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-30159eb8-5f95-42f0-b870-d7153524f415 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:06.912129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-30159eb8-5f95-42f0-b870-d7153524f415 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:06.919779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3f5ce484-60d0-44a5-aef1-ae938d6dce06 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.295182 Apr 19 03:39:06.930412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 77/147] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:06 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:07.013420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-30159eb8-5f95-42f0-b870-d7153524f415 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:07.021814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-30159eb8-5f95-42f0-b870-d7153524f415 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1217 microversion: 2.1 time: 0.114998 Apr 19 03:39:07.022558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 71/148] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:06 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:07.270922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-14a6a417-67b8-4789-bab9-a77f82ba2062 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:07.271987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-14a6a417-67b8-4789-bab9-a77f82ba2062 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:07.280875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-14a6a417-67b8-4789-bab9-a77f82ba2062 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:07.281386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-14a6a417-67b8-4789-bab9-a77f82ba2062 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:07.282210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-14a6a417-67b8-4789-bab9-a77f82ba2062 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:07.282835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-14a6a417-67b8-4789-bab9-a77f82ba2062 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:07.938211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6df49b82-0692-4886-bf44-111fcc040866 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:07.938877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6df49b82-0692-4886-bf44-111fcc040866 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:07.947540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6df49b82-0692-4886-bf44-111fcc040866 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:07.948324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6df49b82-0692-4886-bf44-111fcc040866 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:07.949241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6df49b82-0692-4886-bf44-111fcc040866 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:07.949807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6df49b82-0692-4886-bf44-111fcc040866 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:08.169753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6df49b82-0692-4886-bf44-111fcc040866 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:08.183175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6df49b82-0692-4886-bf44-111fcc040866 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.249045 Apr 19 03:39:08.190964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 72/149] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:07 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:08.195058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d3c95db1-4644-4ba0-89bf-3a1b17ab83a1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:08.195863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d3c95db1-4644-4ba0-89bf-3a1b17ab83a1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:08.204590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3c95db1-4644-4ba0-89bf-3a1b17ab83a1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:08.205082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3c95db1-4644-4ba0-89bf-3a1b17ab83a1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:08.206044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3c95db1-4644-4ba0-89bf-3a1b17ab83a1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:08.206536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3c95db1-4644-4ba0-89bf-3a1b17ab83a1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:08.337770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d3c95db1-4644-4ba0-89bf-3a1b17ab83a1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:08.357995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d3c95db1-4644-4ba0-89bf-3a1b17ab83a1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1221 microversion: 2.1 time: 0.172693 Apr 19 03:39:08.368411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 73/150] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:08 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1221 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:09.200826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-649cdf22-ddee-4390-b7ac-d3b45e6fe71d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:09.201526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-649cdf22-ddee-4390-b7ac-d3b45e6fe71d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:09.209851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-649cdf22-ddee-4390-b7ac-d3b45e6fe71d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:09.210358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-649cdf22-ddee-4390-b7ac-d3b45e6fe71d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:09.211221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-649cdf22-ddee-4390-b7ac-d3b45e6fe71d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:09.211720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-649cdf22-ddee-4390-b7ac-d3b45e6fe71d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:09.450008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-649cdf22-ddee-4390-b7ac-d3b45e6fe71d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:09.462931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-649cdf22-ddee-4390-b7ac-d3b45e6fe71d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.266280 Apr 19 03:39:09.464178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 74/151] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:09 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:09.470823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-45f2cd43-65dd-428d-bdea-a365c3ea31f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:09.471736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-45f2cd43-65dd-428d-bdea-a365c3ea31f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:09.480833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45f2cd43-65dd-428d-bdea-a365c3ea31f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:09.481562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45f2cd43-65dd-428d-bdea-a365c3ea31f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:09.483621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45f2cd43-65dd-428d-bdea-a365c3ea31f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:09.484227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45f2cd43-65dd-428d-bdea-a365c3ea31f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:09.641975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-45f2cd43-65dd-428d-bdea-a365c3ea31f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:09.652234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-45f2cd43-65dd-428d-bdea-a365c3ea31f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1221 microversion: 2.1 time: 0.186535 Apr 19 03:39:09.652851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 75/152] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:09 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1221 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:09.757612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-14a6a417-67b8-4789-bab9-a77f82ba2062 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 14 microversion: 2.1 time: 2.490260 Apr 19 03:39:09.759508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 78/153] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:07 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 14 bytes in 2493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:39:10.481686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-79fa4f24-a246-4131-b27a-bf74fb373c3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:10.483756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-79fa4f24-a246-4131-b27a-bf74fb373c3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:10.493201 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79fa4f24-a246-4131-b27a-bf74fb373c3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:10.494406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79fa4f24-a246-4131-b27a-bf74fb373c3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:10.495212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79fa4f24-a246-4131-b27a-bf74fb373c3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:10.496256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79fa4f24-a246-4131-b27a-bf74fb373c3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:10.672522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-13db04f9-7d2b-4f81-a0f3-551cd46825cb tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:10.673349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-13db04f9-7d2b-4f81-a0f3-551cd46825cb tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:10.693445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13db04f9-7d2b-4f81-a0f3-551cd46825cb tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:10.693445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13db04f9-7d2b-4f81-a0f3-551cd46825cb tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:10.693445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13db04f9-7d2b-4f81-a0f3-551cd46825cb tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:10.695267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13db04f9-7d2b-4f81-a0f3-551cd46825cb tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:10.934605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-13db04f9-7d2b-4f81-a0f3-551cd46825cb tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:10.945671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-13db04f9-7d2b-4f81-a0f3-551cd46825cb tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1269 microversion: 2.1 time: 0.279121 Apr 19 03:39:10.946293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 79/154] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:10 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1269 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:10.953344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-79fa4f24-a246-4131-b27a-bf74fb373c3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:10.962908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4bced9e6-65ac-4d16-aae3-23f26299206f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:10.968552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-79fa4f24-a246-4131-b27a-bf74fb373c3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.490889 Apr 19 03:39:10.968786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4bced9e6-65ac-4d16-aae3-23f26299206f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:10.974345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 76/155] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:10 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:10.988101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4bced9e6-65ac-4d16-aae3-23f26299206f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:10.988876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4bced9e6-65ac-4d16-aae3-23f26299206f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:10.989866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4bced9e6-65ac-4d16-aae3-23f26299206f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:10.990359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4bced9e6-65ac-4d16-aae3-23f26299206f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:11.144927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4bced9e6-65ac-4d16-aae3-23f26299206f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 14 microversion: 2.1 time: 0.197044 Apr 19 03:39:11.145632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 80/156] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:10 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:39:11.964098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2fa63e4d-398a-4301-897f-789ac0fe0241 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:11.965511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2fa63e4d-398a-4301-897f-789ac0fe0241 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:11.974495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2fa63e4d-398a-4301-897f-789ac0fe0241 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:11.975361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2fa63e4d-398a-4301-897f-789ac0fe0241 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:11.976400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2fa63e4d-398a-4301-897f-789ac0fe0241 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:11.977130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2fa63e4d-398a-4301-897f-789ac0fe0241 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:11.997640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b72b6911-5241-42fe-a0aa-889744eedb73 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:11.999197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b72b6911-5241-42fe-a0aa-889744eedb73 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:12.025003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b72b6911-5241-42fe-a0aa-889744eedb73 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:12.025470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b72b6911-5241-42fe-a0aa-889744eedb73 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:12.029060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b72b6911-5241-42fe-a0aa-889744eedb73 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:12.029634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b72b6911-5241-42fe-a0aa-889744eedb73 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:12.217850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2fa63e4d-398a-4301-897f-789ac0fe0241 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:12.230145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2fa63e4d-398a-4301-897f-789ac0fe0241 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.270506 Apr 19 03:39:12.234258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 77/157] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:11 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:12.248784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-56d40553-5d3e-4b10-b905-c779bad044e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:12.252188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-56d40553-5d3e-4b10-b905-c779bad044e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:12.267579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56d40553-5d3e-4b10-b905-c779bad044e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:12.267970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56d40553-5d3e-4b10-b905-c779bad044e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:12.269015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56d40553-5d3e-4b10-b905-c779bad044e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:12.269870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56d40553-5d3e-4b10-b905-c779bad044e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:12.381536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b72b6911-5241-42fe-a0aa-889744eedb73 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:12.392022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b72b6911-5241-42fe-a0aa-889744eedb73 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.406264 Apr 19 03:39:12.392814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 81/158] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:11 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:13.253033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f754cc8b-f5f2-461d-8992-680f0622b6c6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:13.253778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f754cc8b-f5f2-461d-8992-680f0622b6c6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:13.262136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f754cc8b-f5f2-461d-8992-680f0622b6c6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:13.262719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f754cc8b-f5f2-461d-8992-680f0622b6c6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:13.264232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f754cc8b-f5f2-461d-8992-680f0622b6c6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:13.264792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f754cc8b-f5f2-461d-8992-680f0622b6c6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:13.633349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f754cc8b-f5f2-461d-8992-680f0622b6c6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:13.643195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f754cc8b-f5f2-461d-8992-680f0622b6c6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.394961 Apr 19 03:39:13.644119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 82/159] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:13 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:13.654274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bde14e0c-b687-4100-ac0c-80984578116a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:13.654274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bde14e0c-b687-4100-ac0c-80984578116a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:13.677970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bde14e0c-b687-4100-ac0c-80984578116a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:13.680943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bde14e0c-b687-4100-ac0c-80984578116a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:13.682965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bde14e0c-b687-4100-ac0c-80984578116a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:13.685234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bde14e0c-b687-4100-ac0c-80984578116a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:14.005789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bde14e0c-b687-4100-ac0c-80984578116a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:14.017858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bde14e0c-b687-4100-ac0c-80984578116a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.372195 Apr 19 03:39:14.018650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 83/160] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:13 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:14.661698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-79dbe22c-455b-41ab-bb32-80590a08046a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:14.662375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-79dbe22c-455b-41ab-bb32-80590a08046a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:14.670446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79dbe22c-455b-41ab-bb32-80590a08046a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:14.670901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79dbe22c-455b-41ab-bb32-80590a08046a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:14.671813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79dbe22c-455b-41ab-bb32-80590a08046a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:14.672315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79dbe22c-455b-41ab-bb32-80590a08046a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:14.755848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-56d40553-5d3e-4b10-b905-c779bad044e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 14 microversion: 2.1 time: 2.513225 Apr 19 03:39:14.761684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 78/161] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:12 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 14 bytes in 2524 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:39:15.043258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-436a8af2-6f4e-489d-a0d9-d3f0edee4103 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:15.043258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-436a8af2-6f4e-489d-a0d9-d3f0edee4103 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:15.046673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-436a8af2-6f4e-489d-a0d9-d3f0edee4103 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:15.047204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-436a8af2-6f4e-489d-a0d9-d3f0edee4103 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:15.048051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-436a8af2-6f4e-489d-a0d9-d3f0edee4103 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:15.048538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-436a8af2-6f4e-489d-a0d9-d3f0edee4103 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:15.144035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-79dbe22c-455b-41ab-bb32-80590a08046a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:15.153829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-79dbe22c-455b-41ab-bb32-80590a08046a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.496194 Apr 19 03:39:15.154489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 84/162] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:14 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:15.360161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-436a8af2-6f4e-489d-a0d9-d3f0edee4103 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:15.370758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-436a8af2-6f4e-489d-a0d9-d3f0edee4103 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.338166 Apr 19 03:39:15.381959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 79/163] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:15 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:15.770290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-349e8e11-4954-4478-8869-a396f2a3f46a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:15.771366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-349e8e11-4954-4478-8869-a396f2a3f46a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:15.787445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-349e8e11-4954-4478-8869-a396f2a3f46a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:15.788016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-349e8e11-4954-4478-8869-a396f2a3f46a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:15.788869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-349e8e11-4954-4478-8869-a396f2a3f46a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:15.789360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-349e8e11-4954-4478-8869-a396f2a3f46a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:15.934119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-349e8e11-4954-4478-8869-a396f2a3f46a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 14 microversion: 2.1 time: 0.167334 Apr 19 03:39:15.938388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 85/164] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:15 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:39:16.172001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dc6903a1-c0d5-4169-b707-3b85ba103966 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:16.172675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dc6903a1-c0d5-4169-b707-3b85ba103966 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:16.189961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc6903a1-c0d5-4169-b707-3b85ba103966 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:16.190729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc6903a1-c0d5-4169-b707-3b85ba103966 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:16.192049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc6903a1-c0d5-4169-b707-3b85ba103966 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:16.193005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc6903a1-c0d5-4169-b707-3b85ba103966 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:16.360001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-abad4022-f2fb-4901-ad64-76e15a9a14d6 req-0be89eeb-7467-43b6-929b-977f922bca01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b33f3c-869a-4151-b3a8-c8a05fc75694", "tag": "079573e4-5310-4589-883b-946da48f3377"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:16.362857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:39:16.362857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:39:16.397537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-abad4022-f2fb-4901-ad64-76e15a9a14d6 req-0be89eeb-7467-43b6-929b-977f922bca01 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:16.399449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-abad4022-f2fb-4901-ad64-76e15a9a14d6 req-0be89eeb-7467-43b6-929b-977f922bca01 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:16.430679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-abad4022-f2fb-4901-ad64-76e15a9a14d6 req-0be89eeb-7467-43b6-929b-977f922bca01 service nova] Creating event network-changed:079573e4-5310-4589-883b-946da48f3377 for instance 04b33f3c-869a-4151-b3a8-c8a05fc75694 on hv-cinder-78605 Apr 19 03:39:16.430679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-abad4022-f2fb-4901-ad64-76e15a9a14d6 req-0be89eeb-7467-43b6-929b-977f922bca01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079874 Apr 19 03:39:16.433416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 86/165] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:39:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:39:16.439847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-236910fd-a323-47fb-948f-e15683be2830 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:16.440774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-236910fd-a323-47fb-948f-e15683be2830 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:16.449675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-236910fd-a323-47fb-948f-e15683be2830 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:16.450179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-236910fd-a323-47fb-948f-e15683be2830 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:16.451230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-236910fd-a323-47fb-948f-e15683be2830 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:16.451727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-236910fd-a323-47fb-948f-e15683be2830 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:16.645832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dc6903a1-c0d5-4169-b707-3b85ba103966 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:16.658426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dc6903a1-c0d5-4169-b707-3b85ba103966 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.490460 Apr 19 03:39:16.661172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 80/166] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:16 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:16.912221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-236910fd-a323-47fb-948f-e15683be2830 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:16.921929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-236910fd-a323-47fb-948f-e15683be2830 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.487327 Apr 19 03:39:16.922540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 87/167] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:16 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:16.946547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b4f9396d-f493-4168-85dd-c89f8906c0a2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:16.947649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b4f9396d-f493-4168-85dd-c89f8906c0a2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:16.957914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b4f9396d-f493-4168-85dd-c89f8906c0a2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:16.958425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b4f9396d-f493-4168-85dd-c89f8906c0a2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:16.959408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b4f9396d-f493-4168-85dd-c89f8906c0a2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:16.960065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b4f9396d-f493-4168-85dd-c89f8906c0a2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:17.188019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8641adab-1231-4a22-97f5-2f215a6bc54c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:17.188581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8641adab-1231-4a22-97f5-2f215a6bc54c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:17.196752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8641adab-1231-4a22-97f5-2f215a6bc54c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:17.197250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8641adab-1231-4a22-97f5-2f215a6bc54c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:17.198097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8641adab-1231-4a22-97f5-2f215a6bc54c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:17.198605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8641adab-1231-4a22-97f5-2f215a6bc54c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:17.265343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8641adab-1231-4a22-97f5-2f215a6bc54c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Going to try to terminate instance {{(pid=100591) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:39:17.506393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8641adab-1231-4a22-97f5-2f215a6bc54c tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 204 len: 0 microversion: 2.1 time: 0.322168 Apr 19 03:39:17.507384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 88/168] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:39:17 2021] DELETE /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:39:17.516585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d5f75334-e77e-4590-8476-562ca1e5f410 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:17.517268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d5f75334-e77e-4590-8476-562ca1e5f410 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:17.525274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5f75334-e77e-4590-8476-562ca1e5f410 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:17.526118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5f75334-e77e-4590-8476-562ca1e5f410 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:17.526593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5f75334-e77e-4590-8476-562ca1e5f410 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:17.527098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5f75334-e77e-4590-8476-562ca1e5f410 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:17.895860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d5f75334-e77e-4590-8476-562ca1e5f410 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:17.905570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d5f75334-e77e-4590-8476-562ca1e5f410 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1554 microversion: 2.1 time: 0.393850 Apr 19 03:39:17.906501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 89/169] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:17 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1554 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:17.911508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-31dcb0cb-982c-44a1-a3bd-b908052992d7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:17.912378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-31dcb0cb-982c-44a1-a3bd-b908052992d7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:17.921203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31dcb0cb-982c-44a1-a3bd-b908052992d7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:17.921824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31dcb0cb-982c-44a1-a3bd-b908052992d7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:17.922767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31dcb0cb-982c-44a1-a3bd-b908052992d7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:17.923426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31dcb0cb-982c-44a1-a3bd-b908052992d7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:18.205863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-31dcb0cb-982c-44a1-a3bd-b908052992d7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:18.218017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-31dcb0cb-982c-44a1-a3bd-b908052992d7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.310144 Apr 19 03:39:18.218645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 90/170] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:17 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:18.224013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-68166dae-56e4-4b2d-80e3-e4de7a1a749a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:18.224675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-68166dae-56e4-4b2d-80e3-e4de7a1a749a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:18.233745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68166dae-56e4-4b2d-80e3-e4de7a1a749a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:18.234249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68166dae-56e4-4b2d-80e3-e4de7a1a749a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:18.236037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68166dae-56e4-4b2d-80e3-e4de7a1a749a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:18.236536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68166dae-56e4-4b2d-80e3-e4de7a1a749a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:18.484857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-68166dae-56e4-4b2d-80e3-e4de7a1a749a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:18.494561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-68166dae-56e4-4b2d-80e3-e4de7a1a749a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.274569 Apr 19 03:39:18.495372 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 91/171] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:18 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:18.924881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fde95749-e16b-4a2e-a6ea-d442fca40f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:18.925553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fde95749-e16b-4a2e-a6ea-d442fca40f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:18.933401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fde95749-e16b-4a2e-a6ea-d442fca40f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:18.933903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fde95749-e16b-4a2e-a6ea-d442fca40f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:18.934738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fde95749-e16b-4a2e-a6ea-d442fca40f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:18.935282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fde95749-e16b-4a2e-a6ea-d442fca40f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:19.205963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fde95749-e16b-4a2e-a6ea-d442fca40f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:19.215571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fde95749-e16b-4a2e-a6ea-d442fca40f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1554 microversion: 2.1 time: 0.294965 Apr 19 03:39:19.216180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 92/172] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:18 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1554 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:19.235773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7bf75c36-4a70-4bee-b66a-df929f0b215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:19.236443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7bf75c36-4a70-4bee-b66a-df929f0b215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:19.244722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf75c36-4a70-4bee-b66a-df929f0b215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:19.245238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf75c36-4a70-4bee-b66a-df929f0b215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:19.246070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf75c36-4a70-4bee-b66a-df929f0b215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:19.246561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf75c36-4a70-4bee-b66a-df929f0b215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:19.459133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7bf75c36-4a70-4bee-b66a-df929f0b215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:19.468184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7bf75c36-4a70-4bee-b66a-df929f0b215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.236571 Apr 19 03:39:19.468810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 93/173] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:19 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:19.512302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-09f26118-1f42-4bfa-b67a-926adb53c91d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:19.512979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-09f26118-1f42-4bfa-b67a-926adb53c91d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:19.520881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09f26118-1f42-4bfa-b67a-926adb53c91d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:19.521389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09f26118-1f42-4bfa-b67a-926adb53c91d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:19.522219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09f26118-1f42-4bfa-b67a-926adb53c91d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:19.522712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09f26118-1f42-4bfa-b67a-926adb53c91d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:19.745319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-09f26118-1f42-4bfa-b67a-926adb53c91d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:19.754731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-09f26118-1f42-4bfa-b67a-926adb53c91d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.246434 Apr 19 03:39:19.755566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 94/174] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:19 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:20.045733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b4f9396d-f493-4168-85dd-c89f8906c0a2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 11454 microversion: 2.1 time: 3.102886 Apr 19 03:39:20.050304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 81/175] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:16 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 11454 bytes in 3109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:20.236429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bcd870a2-8b9c-405f-8873-05b0c9aa6ec4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:20.236429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bcd870a2-8b9c-405f-8873-05b0c9aa6ec4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:20.244916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcd870a2-8b9c-405f-8873-05b0c9aa6ec4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:20.245527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcd870a2-8b9c-405f-8873-05b0c9aa6ec4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:20.246438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcd870a2-8b9c-405f-8873-05b0c9aa6ec4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:20.246997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcd870a2-8b9c-405f-8873-05b0c9aa6ec4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:20.494276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f3e13bf5-164e-4d76-8a05-b6087a656952 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:20.495880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f3e13bf5-164e-4d76-8a05-b6087a656952 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:20.510973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3e13bf5-164e-4d76-8a05-b6087a656952 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:20.511519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3e13bf5-164e-4d76-8a05-b6087a656952 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:20.512376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3e13bf5-164e-4d76-8a05-b6087a656952 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:20.512877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3e13bf5-164e-4d76-8a05-b6087a656952 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:20.674331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bcd870a2-8b9c-405f-8873-05b0c9aa6ec4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:20.682721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bcd870a2-8b9c-405f-8873-05b0c9aa6ec4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1554 microversion: 2.1 time: 0.452314 Apr 19 03:39:20.683402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 95/176] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:20 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1554 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:20.777223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-171efb44-65b6-417a-bfb0-a0fb7b559a5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:20.777894 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-171efb44-65b6-417a-bfb0-a0fb7b559a5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:20.792097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-171efb44-65b6-417a-bfb0-a0fb7b559a5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:20.792887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-171efb44-65b6-417a-bfb0-a0fb7b559a5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:20.795266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-171efb44-65b6-417a-bfb0-a0fb7b559a5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:20.796605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-171efb44-65b6-417a-bfb0-a0fb7b559a5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:21.054445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-171efb44-65b6-417a-bfb0-a0fb7b559a5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:21.063975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-171efb44-65b6-417a-bfb0-a0fb7b559a5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.295391 Apr 19 03:39:21.064792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 96/177] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:20 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:21.074076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f3e13bf5-164e-4d76-8a05-b6087a656952 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:21.083997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f3e13bf5-164e-4d76-8a05-b6087a656952 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.599688 Apr 19 03:39:21.084980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 82/178] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:20 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:21.088064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4409437f-fd10-4bb5-b454-861c9d696107 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:21.089239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4409437f-fd10-4bb5-b454-861c9d696107 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:21.106186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4409437f-fd10-4bb5-b454-861c9d696107 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:21.106702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4409437f-fd10-4bb5-b454-861c9d696107 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:21.107627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4409437f-fd10-4bb5-b454-861c9d696107 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:21.108122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4409437f-fd10-4bb5-b454-861c9d696107 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:21.229244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4409437f-fd10-4bb5-b454-861c9d696107 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 14483 microversion: 2.1 time: 0.148580 Apr 19 03:39:21.233401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 97/179] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:21 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 14483 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:21.456880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-475908908", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "networks": [{"uuid": "cc00f79a-6e4b-4341-acaa-ebb6b4fd13e5"}]}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:21.567033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] validate_networks() for [('cc00f79a-6e4b-4341-acaa-ebb6b4fd13e5', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:39:21.702652 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-eb67d0dc-ad62-42ed-8d98-3dccd61843a4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:21.703478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-eb67d0dc-ad62-42ed-8d98-3dccd61843a4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:21.718077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb67d0dc-ad62-42ed-8d98-3dccd61843a4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:21.718491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb67d0dc-ad62-42ed-8d98-3dccd61843a4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:21.719385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb67d0dc-ad62-42ed-8d98-3dccd61843a4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:21.719875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb67d0dc-ad62-42ed-8d98-3dccd61843a4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:22.082019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-eb67d0dc-ad62-42ed-8d98-3dccd61843a4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:22.095608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-eb67d0dc-ad62-42ed-8d98-3dccd61843a4 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1554 microversion: 2.1 time: 0.397799 Apr 19 03:39:22.105418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 98/180] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:21 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1554 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:22.105418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dd13d6c8-9454-405b-beed-0f80f07551a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:22.105418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dd13d6c8-9454-405b-beed-0f80f07551a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:22.113266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd13d6c8-9454-405b-beed-0f80f07551a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:22.113770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd13d6c8-9454-405b-beed-0f80f07551a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:22.114896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd13d6c8-9454-405b-beed-0f80f07551a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:22.115097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd13d6c8-9454-405b-beed-0f80f07551a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:22.299561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:39:22.300057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:39:22.300571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:39:22.301026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:39:22.301487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:39:22.311829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:22.312335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:22.313205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:22.313691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:22.334644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Getting quotas for project f3d298f017a843b39a22bd94f3bcfdd1. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:39:22.340469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Getting quotas for user 9d286fb2597d4c10ab08f6317b3a9046 and project f3d298f017a843b39a22bd94f3bcfdd1. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:39:22.353473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:39:22.356261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:39:22.396426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dd13d6c8-9454-405b-beed-0f80f07551a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:22.406686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dd13d6c8-9454-405b-beed-0f80f07551a0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.309288 Apr 19 03:39:22.407405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 99/181] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:22 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:22.419285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-848f7701-118a-42af-b7f4-7087abe23ab1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:22.420974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-848f7701-118a-42af-b7f4-7087abe23ab1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:22.445149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-848f7701-118a-42af-b7f4-7087abe23ab1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:22.445656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-848f7701-118a-42af-b7f4-7087abe23ab1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:22.446669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-848f7701-118a-42af-b7f4-7087abe23ab1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:22.447126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-848f7701-118a-42af-b7f4-7087abe23ab1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:22.487396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-23e55912-5826-4378-9e2d-ffb0cbb8e689 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.034272 Apr 19 03:39:22.490733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 83/182] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:39:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:39:22.502301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8a138755-61a5-4009-9cd9-741179712cd5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:22.503764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8a138755-61a5-4009-9cd9-741179712cd5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:22.514014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a138755-61a5-4009-9cd9-741179712cd5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:22.514634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a138755-61a5-4009-9cd9-741179712cd5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:22.515724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a138755-61a5-4009-9cd9-741179712cd5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:22.516919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a138755-61a5-4009-9cd9-741179712cd5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:22.714480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8a138755-61a5-4009-9cd9-741179712cd5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 16615 microversion: 2.1 time: 0.217605 Apr 19 03:39:22.715182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 84/183] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:22 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 16615 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:22.723104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-606ed486-a61d-4529-9c17-0c41abfff25d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:22.723943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-606ed486-a61d-4529-9c17-0c41abfff25d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:22.726890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-848f7701-118a-42af-b7f4-7087abe23ab1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:22.736229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-848f7701-118a-42af-b7f4-7087abe23ab1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.321530 Apr 19 03:39:22.737032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 100/184] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:22 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:22.809339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-606ed486-a61d-4529-9c17-0c41abfff25d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:22.818144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-606ed486-a61d-4529-9c17-0c41abfff25d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1213 microversion: 2.1 time: 0.099281 Apr 19 03:39:22.818600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 85/185] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:22 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:23.114246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e98d6bbb-a36d-4013-ba5e-50321f797000 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:23.115025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e98d6bbb-a36d-4013-ba5e-50321f797000 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:23.132658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e98d6bbb-a36d-4013-ba5e-50321f797000 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:23.133165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e98d6bbb-a36d-4013-ba5e-50321f797000 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:23.134006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e98d6bbb-a36d-4013-ba5e-50321f797000 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:23.134503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e98d6bbb-a36d-4013-ba5e-50321f797000 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:23.425389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-05d10313-335e-4646-b578-4879c9d612f6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:23.426372 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-05d10313-335e-4646-b578-4879c9d612f6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:23.436959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05d10313-335e-4646-b578-4879c9d612f6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:23.437670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05d10313-335e-4646-b578-4879c9d612f6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:23.438722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05d10313-335e-4646-b578-4879c9d612f6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:23.439424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05d10313-335e-4646-b578-4879c9d612f6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:23.488791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e98d6bbb-a36d-4013-ba5e-50321f797000 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:23.505399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e98d6bbb-a36d-4013-ba5e-50321f797000 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1554 microversion: 2.1 time: 0.395484 Apr 19 03:39:23.506224 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 101/186] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:23 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1554 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:23.727898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-88713e6f-4c5b-4be2-9fdf-d927c3914a44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:23.729517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-88713e6f-4c5b-4be2-9fdf-d927c3914a44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:23.751238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88713e6f-4c5b-4be2-9fdf-d927c3914a44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:23.753774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88713e6f-4c5b-4be2-9fdf-d927c3914a44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:23.756293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88713e6f-4c5b-4be2-9fdf-d927c3914a44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:23.760283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88713e6f-4c5b-4be2-9fdf-d927c3914a44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:24.022155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-05d10313-335e-4646-b578-4879c9d612f6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:24.031946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-05d10313-335e-4646-b578-4879c9d612f6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.610469 Apr 19 03:39:24.032514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 86/187] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:23 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:24.037566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-39179ca9-9724-41db-88a5-f45eda488c6a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:24.038258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-39179ca9-9724-41db-88a5-f45eda488c6a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:24.045958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-39179ca9-9724-41db-88a5-f45eda488c6a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:24.050679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-39179ca9-9724-41db-88a5-f45eda488c6a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:24.050679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-39179ca9-9724-41db-88a5-f45eda488c6a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:24.050679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-39179ca9-9724-41db-88a5-f45eda488c6a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:24.386455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-39179ca9-9724-41db-88a5-f45eda488c6a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:24.396197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-39179ca9-9724-41db-88a5-f45eda488c6a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.362592 Apr 19 03:39:24.396830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 87/188] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:24 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:24.401680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2213ba89-ccc9-4f57-a440-6520b132ec01 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:24.402342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2213ba89-ccc9-4f57-a440-6520b132ec01 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:24.410291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2213ba89-ccc9-4f57-a440-6520b132ec01 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:24.410799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2213ba89-ccc9-4f57-a440-6520b132ec01 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:24.411730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2213ba89-ccc9-4f57-a440-6520b132ec01 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:24.412138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2213ba89-ccc9-4f57-a440-6520b132ec01 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:24.534649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2213ba89-ccc9-4f57-a440-6520b132ec01 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:24.543602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2213ba89-ccc9-4f57-a440-6520b132ec01 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1209 microversion: 2.1 time: 0.145707 Apr 19 03:39:24.544208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 88/189] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:24 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1209 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:24.549341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-0523cf2d-ff08-4863-8dc1-2fb37f2dc2e7 req-40df779e-a4bd-4c96-8f2d-b121120848cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99f109f9-2733-4c58-8a4d-edc40ed82783", "name": "network-vif-deleted", "tag": "64a0c86b-eb65-45fc-9eaf-18e538c2f777"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:24.551320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:39:24.551320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:39:24.560806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-0523cf2d-ff08-4863-8dc1-2fb37f2dc2e7 req-40df779e-a4bd-4c96-8f2d-b121120848cf service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:24.561303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-0523cf2d-ff08-4863-8dc1-2fb37f2dc2e7 req-40df779e-a4bd-4c96-8f2d-b121120848cf service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:24.579048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-0523cf2d-ff08-4863-8dc1-2fb37f2dc2e7 req-40df779e-a4bd-4c96-8f2d-b121120848cf service nova] Creating event network-vif-deleted:64a0c86b-eb65-45fc-9eaf-18e538c2f777 for instance 99f109f9-2733-4c58-8a4d-edc40ed82783 on hv-cinder-78605 Apr 19 03:39:24.584457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-0523cf2d-ff08-4863-8dc1-2fb37f2dc2e7 req-40df779e-a4bd-4c96-8f2d-b121120848cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038849 Apr 19 03:39:24.585111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 89/190] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:39:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:39:24.590466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-16f63e64-b04b-43e4-8748-9b3169945e6f tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:24.591288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-16f63e64-b04b-43e4-8748-9b3169945e6f tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:24.599325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-16f63e64-b04b-43e4-8748-9b3169945e6f tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:24.603035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-16f63e64-b04b-43e4-8748-9b3169945e6f tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:24.603035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-16f63e64-b04b-43e4-8748-9b3169945e6f tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:24.603035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-16f63e64-b04b-43e4-8748-9b3169945e6f tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:24.802370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-16f63e64-b04b-43e4-8748-9b3169945e6f tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:24.812516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-16f63e64-b04b-43e4-8748-9b3169945e6f tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1512 microversion: 2.1 time: 0.226222 Apr 19 03:39:24.813137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 90/191] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:24 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1512 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:25.050389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-62435805-0392-4384-a0f6-ade0b156bbae tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:25.051040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-62435805-0392-4384-a0f6-ade0b156bbae tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:25.059123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-62435805-0392-4384-a0f6-ade0b156bbae tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:25.059676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-62435805-0392-4384-a0f6-ade0b156bbae tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:25.061114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-62435805-0392-4384-a0f6-ade0b156bbae tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:25.061611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-62435805-0392-4384-a0f6-ade0b156bbae tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:25.274933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-62435805-0392-4384-a0f6-ade0b156bbae tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:25.285708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-62435805-0392-4384-a0f6-ade0b156bbae tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.239443 Apr 19 03:39:25.286235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 91/192] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:25 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:25.413819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9dc8847e-06c6-4cd8-a345-b8db8cc9903a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:25.414492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9dc8847e-06c6-4cd8-a345-b8db8cc9903a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:25.422982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9dc8847e-06c6-4cd8-a345-b8db8cc9903a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:25.423512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9dc8847e-06c6-4cd8-a345-b8db8cc9903a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:25.424337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9dc8847e-06c6-4cd8-a345-b8db8cc9903a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:25.424826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9dc8847e-06c6-4cd8-a345-b8db8cc9903a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:25.646320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9dc8847e-06c6-4cd8-a345-b8db8cc9903a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:25.655996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9dc8847e-06c6-4cd8-a345-b8db8cc9903a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.246153 Apr 19 03:39:25.656602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 92/193] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:25 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:25.661468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0c4a4b3e-1638-4647-a548-7b97299fc354 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:25.662132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0c4a4b3e-1638-4647-a548-7b97299fc354 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:25.669755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c4a4b3e-1638-4647-a548-7b97299fc354 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:25.670266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c4a4b3e-1638-4647-a548-7b97299fc354 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:25.671096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c4a4b3e-1638-4647-a548-7b97299fc354 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:25.671618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c4a4b3e-1638-4647-a548-7b97299fc354 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:25.796839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0c4a4b3e-1638-4647-a548-7b97299fc354 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:25.805528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0c4a4b3e-1638-4647-a548-7b97299fc354 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1209 microversion: 2.1 time: 0.147766 Apr 19 03:39:25.806145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 93/194] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:25 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1209 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:25.833457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8d4ae0c0-e095-43f4-bcae-d5b521c45f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:25.834127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8d4ae0c0-e095-43f4-bcae-d5b521c45f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:25.842673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d4ae0c0-e095-43f4-bcae-d5b521c45f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:25.843285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d4ae0c0-e095-43f4-bcae-d5b521c45f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:25.844124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d4ae0c0-e095-43f4-bcae-d5b521c45f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:25.844613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d4ae0c0-e095-43f4-bcae-d5b521c45f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:25.977883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8d4ae0c0-e095-43f4-bcae-d5b521c45f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:25.989788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8d4ae0c0-e095-43f4-bcae-d5b521c45f33 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1512 microversion: 2.1 time: 0.160134 Apr 19 03:39:25.990749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 94/195] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:25 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:26.304400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7c51b3f5-6eac-4395-a344-304be777ffcb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:26.305113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7c51b3f5-6eac-4395-a344-304be777ffcb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:26.313518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c51b3f5-6eac-4395-a344-304be777ffcb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:26.314120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c51b3f5-6eac-4395-a344-304be777ffcb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:26.315020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c51b3f5-6eac-4395-a344-304be777ffcb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:26.315534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c51b3f5-6eac-4395-a344-304be777ffcb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:26.536119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7c51b3f5-6eac-4395-a344-304be777ffcb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:26.545890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7c51b3f5-6eac-4395-a344-304be777ffcb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.245704 Apr 19 03:39:26.550186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 95/196] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:26 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:26.674440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-020a4bc0-0ff6-4133-b685-269772242bc8 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:26.675116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-020a4bc0-0ff6-4133-b685-269772242bc8 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:26.682949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-020a4bc0-0ff6-4133-b685-269772242bc8 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:26.683483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-020a4bc0-0ff6-4133-b685-269772242bc8 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:26.684326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-020a4bc0-0ff6-4133-b685-269772242bc8 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:26.684853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-020a4bc0-0ff6-4133-b685-269772242bc8 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:26.895561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-020a4bc0-0ff6-4133-b685-269772242bc8 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:26.904925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-020a4bc0-0ff6-4133-b685-269772242bc8 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.234637 Apr 19 03:39:26.905538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 96/197] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:26 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:26.910145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-00edb29e-2b16-4208-ae80-40fd66cf61d7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:26.910838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-00edb29e-2b16-4208-ae80-40fd66cf61d7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:26.918108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00edb29e-2b16-4208-ae80-40fd66cf61d7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:26.918610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00edb29e-2b16-4208-ae80-40fd66cf61d7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:26.920036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00edb29e-2b16-4208-ae80-40fd66cf61d7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:26.920557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00edb29e-2b16-4208-ae80-40fd66cf61d7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:26.986668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-88713e6f-4c5b-4be2-9fdf-d927c3914a44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 20985 microversion: 2.1 time: 3.264142 Apr 19 03:39:26.987805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 102/198] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:23 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 20985 bytes in 3266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:27.009664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2369f998-9124-4a40-a741-3ee290e56e08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:27.010432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2369f998-9124-4a40-a741-3ee290e56e08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:27.019829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2369f998-9124-4a40-a741-3ee290e56e08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:27.020351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2369f998-9124-4a40-a741-3ee290e56e08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:27.021276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2369f998-9124-4a40-a741-3ee290e56e08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:27.021773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2369f998-9124-4a40-a741-3ee290e56e08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:27.065932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-00edb29e-2b16-4208-ae80-40fd66cf61d7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:27.077992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-00edb29e-2b16-4208-ae80-40fd66cf61d7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1209 microversion: 2.1 time: 0.171367 Apr 19 03:39:27.079290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 97/199] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:26 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1209 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:27.172911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2369f998-9124-4a40-a741-3ee290e56e08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:27.182764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2369f998-9124-4a40-a741-3ee290e56e08 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1346 microversion: 2.1 time: 0.177906 Apr 19 03:39:27.183421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 103/200] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:27 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:27.567037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5783f013-340b-4c74-8b40-750966827373 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:27.568261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5783f013-340b-4c74-8b40-750966827373 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:27.578776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5783f013-340b-4c74-8b40-750966827373 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:27.579306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5783f013-340b-4c74-8b40-750966827373 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:27.580148 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5783f013-340b-4c74-8b40-750966827373 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:27.580714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5783f013-340b-4c74-8b40-750966827373 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:27.929569 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-efc6d455-3c8a-4cad-bebd-9ded811d3cd9 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:27.931461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-efc6d455-3c8a-4cad-bebd-9ded811d3cd9 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:27.941459 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efc6d455-3c8a-4cad-bebd-9ded811d3cd9 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:27.942191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efc6d455-3c8a-4cad-bebd-9ded811d3cd9 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:27.943207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efc6d455-3c8a-4cad-bebd-9ded811d3cd9 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:27.943845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efc6d455-3c8a-4cad-bebd-9ded811d3cd9 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:28.127690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5783f013-340b-4c74-8b40-750966827373 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:28.151882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5783f013-340b-4c74-8b40-750966827373 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.589133 Apr 19 03:39:28.154300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 98/201] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:27 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:28.163562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f41e20b3-221c-4391-9740-e4b2aa419017 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:28.165129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f41e20b3-221c-4391-9740-e4b2aa419017 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:28.175030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f41e20b3-221c-4391-9740-e4b2aa419017 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:28.175761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f41e20b3-221c-4391-9740-e4b2aa419017 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:28.176789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f41e20b3-221c-4391-9740-e4b2aa419017 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:28.177432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f41e20b3-221c-4391-9740-e4b2aa419017 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:28.208585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-efc6d455-3c8a-4cad-bebd-9ded811d3cd9 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:28.221316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-efc6d455-3c8a-4cad-bebd-9ded811d3cd9 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.303241 Apr 19 03:39:28.222166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 104/202] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:27 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:28.238412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dfa61950-6571-49bd-a612-f820ee199d24 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:28.239087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dfa61950-6571-49bd-a612-f820ee199d24 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:28.259283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfa61950-6571-49bd-a612-f820ee199d24 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:28.259870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfa61950-6571-49bd-a612-f820ee199d24 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:28.265641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfa61950-6571-49bd-a612-f820ee199d24 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:28.265641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfa61950-6571-49bd-a612-f820ee199d24 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:28.314019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f41e20b3-221c-4391-9740-e4b2aa419017 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 22482 microversion: 2.1 time: 0.154845 Apr 19 03:39:28.325690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 99/203] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:28 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 22482 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:28.339031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:28.340503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:28.364912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:28.365651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:28.366707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:28.367427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:28.397112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dfa61950-6571-49bd-a612-f820ee199d24 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:28.410159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dfa61950-6571-49bd-a612-f820ee199d24 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1271 microversion: 2.1 time: 0.176506 Apr 19 03:39:28.412309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 105/204] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:28 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:28.538516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:28.539059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:28.539621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lazy-loading 'fault' on Instance uuid 99f109f9-2733-4c58-8a4d-edc40ed82783 {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:39:28.638903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19995635214248febf6983e992840a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc1d56df10834f75acdb214616014031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:28.650522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-945347ab-9432-47c2-94c1-208b8e22fadb tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 200 len: 1351 microversion: 2.1 time: 0.323040 Apr 19 03:39:28.651207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 100/205] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:28 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 1351 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:29.172595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-606fe61a-ba09-4e03-9747-abda4d2383ca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:29.173259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-606fe61a-ba09-4e03-9747-abda4d2383ca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:29.180955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-606fe61a-ba09-4e03-9747-abda4d2383ca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:29.181468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-606fe61a-ba09-4e03-9747-abda4d2383ca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:29.182286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-606fe61a-ba09-4e03-9747-abda4d2383ca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:29.182769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-606fe61a-ba09-4e03-9747-abda4d2383ca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:29.239886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d3ebd07c-a502-454c-8e7b-ac10b7c30710 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:29.240848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d3ebd07c-a502-454c-8e7b-ac10b7c30710 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:29.249400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3ebd07c-a502-454c-8e7b-ac10b7c30710 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:29.250392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3ebd07c-a502-454c-8e7b-ac10b7c30710 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:29.251443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3ebd07c-a502-454c-8e7b-ac10b7c30710 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:29.252097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3ebd07c-a502-454c-8e7b-ac10b7c30710 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:29.405443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-606fe61a-ba09-4e03-9747-abda4d2383ca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:29.415850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-606fe61a-ba09-4e03-9747-abda4d2383ca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.247603 Apr 19 03:39:29.420003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 106/206] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:29 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:29.422638 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b0f22f58-b58b-43b6-a500-5b55a41d326e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:29.423832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b0f22f58-b58b-43b6-a500-5b55a41d326e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:29.432069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b0f22f58-b58b-43b6-a500-5b55a41d326e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:29.432568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b0f22f58-b58b-43b6-a500-5b55a41d326e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:29.433391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b0f22f58-b58b-43b6-a500-5b55a41d326e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:29.433874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b0f22f58-b58b-43b6-a500-5b55a41d326e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:29.507708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d3ebd07c-a502-454c-8e7b-ac10b7c30710 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:29.517865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d3ebd07c-a502-454c-8e7b-ac10b7c30710 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.282406 Apr 19 03:39:29.521857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 101/207] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:29 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:29.527458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-294a7b28-2b27-4b2e-b029-99af5786517d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:29.528128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-294a7b28-2b27-4b2e-b029-99af5786517d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:29.535928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-294a7b28-2b27-4b2e-b029-99af5786517d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:29.536431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-294a7b28-2b27-4b2e-b029-99af5786517d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:29.537276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-294a7b28-2b27-4b2e-b029-99af5786517d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:29.537770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-294a7b28-2b27-4b2e-b029-99af5786517d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:29.891966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-294a7b28-2b27-4b2e-b029-99af5786517d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:29.900972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-294a7b28-2b27-4b2e-b029-99af5786517d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1313 microversion: 2.1 time: 0.381475 Apr 19 03:39:29.901596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 102/208] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:29 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:29.906777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bcdc1e77-8650-4798-a3e5-0a7a0fc166e7 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:29.907464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bcdc1e77-8650-4798-a3e5-0a7a0fc166e7 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:29.914899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcdc1e77-8650-4798-a3e5-0a7a0fc166e7 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:29.915403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcdc1e77-8650-4798-a3e5-0a7a0fc166e7 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:29.916233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcdc1e77-8650-4798-a3e5-0a7a0fc166e7 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:29.916727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcdc1e77-8650-4798-a3e5-0a7a0fc166e7 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:29.972369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-bcdc1e77-8650-4798-a3e5-0a7a0fc166e7 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] HTTP exception thrown: Instance 99f109f9-2733-4c58-8a4d-edc40ed82783 could not be found. Apr 19 03:39:29.973046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bcdc1e77-8650-4798-a3e5-0a7a0fc166e7 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Returning 404 to user: Instance 99f109f9-2733-4c58-8a4d-edc40ed82783 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:39:29.973956 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bcdc1e77-8650-4798-a3e5-0a7a0fc166e7 tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 404 len: 111 microversion: 2.1 time: 0.071360 Apr 19 03:39:29.974568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 103/209] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:29 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:39:30.434198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-906ea367-5584-4b6b-af70-d96971a85811 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:30.435472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-906ea367-5584-4b6b-af70-d96971a85811 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:30.446656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-906ea367-5584-4b6b-af70-d96971a85811 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:30.447185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-906ea367-5584-4b6b-af70-d96971a85811 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:30.448031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-906ea367-5584-4b6b-af70-d96971a85811 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:30.448517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-906ea367-5584-4b6b-af70-d96971a85811 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:30.673618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-906ea367-5584-4b6b-af70-d96971a85811 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:30.683410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-906ea367-5584-4b6b-af70-d96971a85811 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.253163 Apr 19 03:39:30.684266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 104/210] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:30 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:30.689360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7e2636a0-6537-44cb-9cdf-5e56f3aef1f3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:30.690020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7e2636a0-6537-44cb-9cdf-5e56f3aef1f3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:30.697789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e2636a0-6537-44cb-9cdf-5e56f3aef1f3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:30.698292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e2636a0-6537-44cb-9cdf-5e56f3aef1f3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:30.699124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e2636a0-6537-44cb-9cdf-5e56f3aef1f3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:30.699641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e2636a0-6537-44cb-9cdf-5e56f3aef1f3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:30.935656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7e2636a0-6537-44cb-9cdf-5e56f3aef1f3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:30.944881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7e2636a0-6537-44cb-9cdf-5e56f3aef1f3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.259780 Apr 19 03:39:30.945505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 105/211] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:30 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:30.955355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6c45bbbb-05ca-4ff2-aef0-b3af833a31cb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:30.955355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6c45bbbb-05ca-4ff2-aef0-b3af833a31cb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:30.964134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c45bbbb-05ca-4ff2-aef0-b3af833a31cb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:30.964710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c45bbbb-05ca-4ff2-aef0-b3af833a31cb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:30.965628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c45bbbb-05ca-4ff2-aef0-b3af833a31cb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:30.966239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c45bbbb-05ca-4ff2-aef0-b3af833a31cb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:31.246814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6c45bbbb-05ca-4ff2-aef0-b3af833a31cb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:31.257132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6c45bbbb-05ca-4ff2-aef0-b3af833a31cb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1313 microversion: 2.1 time: 0.310572 Apr 19 03:39:31.257838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 106/212] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:30 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:31.702282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f3bb6991-edff-4873-9eae-2b18761bb64f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:31.702961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f3bb6991-edff-4873-9eae-2b18761bb64f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:31.711372 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3bb6991-edff-4873-9eae-2b18761bb64f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:31.711888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3bb6991-edff-4873-9eae-2b18761bb64f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:31.712734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3bb6991-edff-4873-9eae-2b18761bb64f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:31.713233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3bb6991-edff-4873-9eae-2b18761bb64f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:31.930822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f3bb6991-edff-4873-9eae-2b18761bb64f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:31.958013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f3bb6991-edff-4873-9eae-2b18761bb64f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.255443 Apr 19 03:39:31.960628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 107/213] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:31 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:31.974564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b0f22f58-b58b-43b6-a500-5b55a41d326e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 26142 microversion: 2.1 time: 2.556290 Apr 19 03:39:31.975992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 107/214] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:29 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 26142 bytes in 2559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:31.981068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-65e834a7-b5b6-4400-80f2-4db6317b54e7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:31.982217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-65e834a7-b5b6-4400-80f2-4db6317b54e7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:31.999727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65e834a7-b5b6-4400-80f2-4db6317b54e7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:32.000174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65e834a7-b5b6-4400-80f2-4db6317b54e7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:32.001025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65e834a7-b5b6-4400-80f2-4db6317b54e7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:32.001509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65e834a7-b5b6-4400-80f2-4db6317b54e7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:32.278619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0340b635-16f6-4966-bb4e-296e8d312dde tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:32.280182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0340b635-16f6-4966-bb4e-296e8d312dde tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:32.292639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0340b635-16f6-4966-bb4e-296e8d312dde tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:32.293325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0340b635-16f6-4966-bb4e-296e8d312dde tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:32.295222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0340b635-16f6-4966-bb4e-296e8d312dde tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:32.296189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0340b635-16f6-4966-bb4e-296e8d312dde tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:32.537136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0340b635-16f6-4966-bb4e-296e8d312dde tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:32.546546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0340b635-16f6-4966-bb4e-296e8d312dde tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1313 microversion: 2.1 time: 0.275278 Apr 19 03:39:32.556927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 108/215] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:32 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:32.562911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-f2f9e447-c0be-4322-963d-82c3378695b7 req-ecf2a39b-f3e5-4e82-a0ac-2268d52e6a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b33f3c-869a-4151-b3a8-c8a05fc75694", "name": "network-vif-plugged", "status": "completed", "tag": "079573e4-5310-4589-883b-946da48f3377"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:32.564640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:39:32.564640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:39:32.574123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-f2f9e447-c0be-4322-963d-82c3378695b7 req-ecf2a39b-f3e5-4e82-a0ac-2268d52e6a3c service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:32.574628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-f2f9e447-c0be-4322-963d-82c3378695b7 req-ecf2a39b-f3e5-4e82-a0ac-2268d52e6a3c service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:32.594286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-f2f9e447-c0be-4322-963d-82c3378695b7 req-ecf2a39b-f3e5-4e82-a0ac-2268d52e6a3c service nova] Creating event network-vif-plugged:079573e4-5310-4589-883b-946da48f3377 for instance 04b33f3c-869a-4151-b3a8-c8a05fc75694 on hv-cinder-78605 Apr 19 03:39:32.600443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-f2f9e447-c0be-4322-963d-82c3378695b7 req-ecf2a39b-f3e5-4e82-a0ac-2268d52e6a3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042083 Apr 19 03:39:32.602388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 109/216] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:39:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:39:32.648390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-65e834a7-b5b6-4400-80f2-4db6317b54e7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:32.661706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-65e834a7-b5b6-4400-80f2-4db6317b54e7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.699676 Apr 19 03:39:32.663033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 108/217] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:31 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:32.980412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7055ea6a-b8f0-4b8a-b952-bc0d0650f158 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:32.989476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e4c9ae86-687a-4f28-b4ea-f57c854dfe62 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:32.990696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e4c9ae86-687a-4f28-b4ea-f57c854dfe62 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:32.991708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7055ea6a-b8f0-4b8a-b952-bc0d0650f158 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:33.011563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e4c9ae86-687a-4f28-b4ea-f57c854dfe62 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.012153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e4c9ae86-687a-4f28-b4ea-f57c854dfe62 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:33.013280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e4c9ae86-687a-4f28-b4ea-f57c854dfe62 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.013558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7055ea6a-b8f0-4b8a-b952-bc0d0650f158 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.014624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7055ea6a-b8f0-4b8a-b952-bc0d0650f158 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:33.016016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e4c9ae86-687a-4f28-b4ea-f57c854dfe62 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:33.016339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7055ea6a-b8f0-4b8a-b952-bc0d0650f158 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.018076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7055ea6a-b8f0-4b8a-b952-bc0d0650f158 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:33.255461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e4c9ae86-687a-4f28-b4ea-f57c854dfe62 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 26906 microversion: 2.1 time: 0.270267 Apr 19 03:39:33.256912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 109/218] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:32 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 26906 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:33.304545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7055ea6a-b8f0-4b8a-b952-bc0d0650f158 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:33.314182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7055ea6a-b8f0-4b8a-b952-bc0d0650f158 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.340208 Apr 19 03:39:33.315056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 110/219] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:32 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:33.405778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-3b8c25e3-fe21-425e-8df9-310a946e014d req-952c9960-6143-4a55-bde4-f0fc9b2a1b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12cbafd-bf5a-464a-831a-517e91bce6df", "tag": "c68f1269-d312-4c49-81ad-d808f6473ee8"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:33.412266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:39:33.412266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:39:33.418338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-3b8c25e3-fe21-425e-8df9-310a946e014d req-952c9960-6143-4a55-bde4-f0fc9b2a1b80 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.419095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-3b8c25e3-fe21-425e-8df9-310a946e014d req-952c9960-6143-4a55-bde4-f0fc9b2a1b80 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:33.443451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-3b8c25e3-fe21-425e-8df9-310a946e014d req-952c9960-6143-4a55-bde4-f0fc9b2a1b80 service nova] Creating event network-changed:c68f1269-d312-4c49-81ad-d808f6473ee8 for instance c12cbafd-bf5a-464a-831a-517e91bce6df on hv-cinder-78605 Apr 19 03:39:33.448791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-3b8c25e3-fe21-425e-8df9-310a946e014d req-952c9960-6143-4a55-bde4-f0fc9b2a1b80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047301 Apr 19 03:39:33.449464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 110/220] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:39:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:39:33.564967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8bebee84-c0ec-48c9-8cde-6010c270f3ac tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:33.565820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8bebee84-c0ec-48c9-8cde-6010c270f3ac tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:33.576494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bebee84-c0ec-48c9-8cde-6010c270f3ac tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.577274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bebee84-c0ec-48c9-8cde-6010c270f3ac tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:33.579012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bebee84-c0ec-48c9-8cde-6010c270f3ac tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.579981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bebee84-c0ec-48c9-8cde-6010c270f3ac tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:33.682226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9bc5bd56-056b-4691-82ae-f648c2b4aa6d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:33.683927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9bc5bd56-056b-4691-82ae-f648c2b4aa6d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:33.704227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9bc5bd56-056b-4691-82ae-f648c2b4aa6d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.705087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9bc5bd56-056b-4691-82ae-f648c2b4aa6d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:33.706167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9bc5bd56-056b-4691-82ae-f648c2b4aa6d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.711460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9bc5bd56-056b-4691-82ae-f648c2b4aa6d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:33.906974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8bebee84-c0ec-48c9-8cde-6010c270f3ac tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:33.916357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8bebee84-c0ec-48c9-8cde-6010c270f3ac tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1313 microversion: 2.1 time: 0.355587 Apr 19 03:39:33.917296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 111/221] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:33 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:33.966802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2bf0bdb3-85e9-47ba-b9e7-07a1407e1b9a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:33.967406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2bf0bdb3-85e9-47ba-b9e7-07a1407e1b9a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:33.976180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2bf0bdb3-85e9-47ba-b9e7-07a1407e1b9a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.981520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2bf0bdb3-85e9-47ba-b9e7-07a1407e1b9a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:33.981520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2bf0bdb3-85e9-47ba-b9e7-07a1407e1b9a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:33.981520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2bf0bdb3-85e9-47ba-b9e7-07a1407e1b9a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:34.035654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-2bf0bdb3-85e9-47ba-b9e7-07a1407e1b9a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] HTTP exception thrown: Instance 99f109f9-2733-4c58-8a4d-edc40ed82783 could not be found. Apr 19 03:39:34.036446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2bf0bdb3-85e9-47ba-b9e7-07a1407e1b9a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Returning 404 to user: Instance 99f109f9-2733-4c58-8a4d-edc40ed82783 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:39:34.037321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2bf0bdb3-85e9-47ba-b9e7-07a1407e1b9a tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "DELETE /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 404 len: 111 microversion: 2.1 time: 0.075671 Apr 19 03:39:34.037921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 112/222] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:39:33 2021] DELETE /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 03:39:34.046500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-33fd301f-faf6-4fe3-8567-08e11c20656d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:34.047185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-33fd301f-faf6-4fe3-8567-08e11c20656d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] [instance: 99f109f9-2733-4c58-8a4d-edc40ed82783] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:34.054809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33fd301f-faf6-4fe3-8567-08e11c20656d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:34.055345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33fd301f-faf6-4fe3-8567-08e11c20656d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:34.056172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33fd301f-faf6-4fe3-8567-08e11c20656d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:34.056657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33fd301f-faf6-4fe3-8567-08e11c20656d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:34.114406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-33fd301f-faf6-4fe3-8567-08e11c20656d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] HTTP exception thrown: Instance 99f109f9-2733-4c58-8a4d-edc40ed82783 could not be found. Apr 19 03:39:34.115073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-33fd301f-faf6-4fe3-8567-08e11c20656d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] Returning 404 to user: Instance 99f109f9-2733-4c58-8a4d-edc40ed82783 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:39:34.116011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-33fd301f-faf6-4fe3-8567-08e11c20656d tempest-DeleteServersTestJSON-1567489883 tempest-DeleteServersTestJSON-1567489883-project] 10.222.0.25 "GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783" status: 404 len: 111 microversion: 2.1 time: 0.073689 Apr 19 03:39:34.116837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 113/223] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:34 2021] GET /compute/v2.1/servers/99f109f9-2733-4c58-8a4d-edc40ed82783 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 03:39:34.186906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9bc5bd56-056b-4691-82ae-f648c2b4aa6d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:34.197735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9bc5bd56-056b-4691-82ae-f648c2b4aa6d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1317 microversion: 2.1 time: 0.520478 Apr 19 03:39:34.211134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 111/224] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:33 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:34.275412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4012a817-c6eb-4198-ab5c-c550a27c73a0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:34.275412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4012a817-c6eb-4198-ab5c-c550a27c73a0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:34.289825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4012a817-c6eb-4198-ab5c-c550a27c73a0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:34.290592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4012a817-c6eb-4198-ab5c-c550a27c73a0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:34.292567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4012a817-c6eb-4198-ab5c-c550a27c73a0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:34.294936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4012a817-c6eb-4198-ab5c-c550a27c73a0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:34.335668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5952001a-5571-4921-8487-a38ef7bd38f5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:34.340802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5952001a-5571-4921-8487-a38ef7bd38f5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:34.344776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5952001a-5571-4921-8487-a38ef7bd38f5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:34.345320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5952001a-5571-4921-8487-a38ef7bd38f5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:34.346234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5952001a-5571-4921-8487-a38ef7bd38f5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:34.346653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5952001a-5571-4921-8487-a38ef7bd38f5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:34.492617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4012a817-c6eb-4198-ab5c-c550a27c73a0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 27332 microversion: 2.1 time: 0.226168 Apr 19 03:39:34.493502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 114/225] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:34 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 27332 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:34.761827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5952001a-5571-4921-8487-a38ef7bd38f5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:34.771431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5952001a-5571-4921-8487-a38ef7bd38f5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.442479 Apr 19 03:39:34.772483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 112/226] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:34 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:34.936007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-89b1d551-0257-4896-adad-d6105cc5d930 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:34.936940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-89b1d551-0257-4896-adad-d6105cc5d930 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:34.946205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89b1d551-0257-4896-adad-d6105cc5d930 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:34.946842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89b1d551-0257-4896-adad-d6105cc5d930 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:34.947823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89b1d551-0257-4896-adad-d6105cc5d930 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:34.948436 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89b1d551-0257-4896-adad-d6105cc5d930 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:35.185849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-89b1d551-0257-4896-adad-d6105cc5d930 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:35.194845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-89b1d551-0257-4896-adad-d6105cc5d930 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1313 microversion: 2.1 time: 0.264523 Apr 19 03:39:35.195473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 115/227] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:34 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:35.218596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fe341ab7-e910-4fc8-8017-a4f3cc651855 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:35.219872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fe341ab7-e910-4fc8-8017-a4f3cc651855 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:35.230337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe341ab7-e910-4fc8-8017-a4f3cc651855 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:35.231367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe341ab7-e910-4fc8-8017-a4f3cc651855 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:35.233840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe341ab7-e910-4fc8-8017-a4f3cc651855 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:35.234498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe341ab7-e910-4fc8-8017-a4f3cc651855 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:35.506395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6e7d822e-e57c-43d5-afe7-f356a8cd729a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:35.507171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6e7d822e-e57c-43d5-afe7-f356a8cd729a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:35.516063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e7d822e-e57c-43d5-afe7-f356a8cd729a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:35.516566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e7d822e-e57c-43d5-afe7-f356a8cd729a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:35.517408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e7d822e-e57c-43d5-afe7-f356a8cd729a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:35.517896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e7d822e-e57c-43d5-afe7-f356a8cd729a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:35.615012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fe341ab7-e910-4fc8-8017-a4f3cc651855 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:35.624464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fe341ab7-e910-4fc8-8017-a4f3cc651855 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1507 microversion: 2.1 time: 0.410423 Apr 19 03:39:35.625070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 113/228] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:35 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:35.642122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-093a09d9-6b62-416f-8df2-00931a34795d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3badd6a8-41ac-43ea-9736-b322298d7571"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:35.643301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-093a09d9-6b62-416f-8df2-00931a34795d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:35.650719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-093a09d9-6b62-416f-8df2-00931a34795d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:35.651250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-093a09d9-6b62-416f-8df2-00931a34795d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:35.652077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-093a09d9-6b62-416f-8df2-00931a34795d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:35.652557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-093a09d9-6b62-416f-8df2-00931a34795d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:35.822225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6e7d822e-e57c-43d5-afe7-f356a8cd729a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 27702 microversion: 2.1 time: 0.319845 Apr 19 03:39:35.823108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 116/229] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:35 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 27702 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:35.837124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f7bc7d98-f12d-4bf5-825e-2e40cce376be tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:35.838919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f7bc7d98-f12d-4bf5-825e-2e40cce376be tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:35.849018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7bc7d98-f12d-4bf5-825e-2e40cce376be tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:35.849708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7bc7d98-f12d-4bf5-825e-2e40cce376be tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:35.850967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7bc7d98-f12d-4bf5-825e-2e40cce376be tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:35.851850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7bc7d98-f12d-4bf5-825e-2e40cce376be tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:35.880330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-093a09d9-6b62-416f-8df2-00931a34795d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] HTTP exception thrown: Invalid volume: volume 3badd6a8-41ac-43ea-9736-b322298d7571 is already attached to instances: e896d6d6-dd30-46c4-a04f-e9225a22a58d Apr 19 03:39:35.881109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-093a09d9-6b62-416f-8df2-00931a34795d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Returning 400 to user: Invalid volume: volume 3badd6a8-41ac-43ea-9736-b322298d7571 is already attached to instances: e896d6d6-dd30-46c4-a04f-e9225a22a58d {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:39:35.882385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-093a09d9-6b62-416f-8df2-00931a34795d tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "POST /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.244765 Apr 19 03:39:35.883103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 114/230] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:39:35 2021] POST /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694/os-volume_attachments => generated 174 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 19 03:39:35.997954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8313c991-7d65-42ae-bf78-52f9ff56db67 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:35.998497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8313c991-7d65-42ae-bf78-52f9ff56db67 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:36.006430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8313c991-7d65-42ae-bf78-52f9ff56db67 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:36.006895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8313c991-7d65-42ae-bf78-52f9ff56db67 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:36.007934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8313c991-7d65-42ae-bf78-52f9ff56db67 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:36.008593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8313c991-7d65-42ae-bf78-52f9ff56db67 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:36.111007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f7bc7d98-f12d-4bf5-825e-2e40cce376be tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:36.124711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f7bc7d98-f12d-4bf5-825e-2e40cce376be tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.292720 Apr 19 03:39:36.125878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 117/231] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:35 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:36.193219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-8313c991-7d65-42ae-bf78-52f9ff56db67 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lazy-loading 'services' on Instance uuid e896d6d6-dd30-46c4-a04f-e9225a22a58d {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:39:36.218818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3e777cdd-21dc-4af9-85c0-32757bf99b7a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:36.222208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3e777cdd-21dc-4af9-85c0-32757bf99b7a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:36.238071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e777cdd-21dc-4af9-85c0-32757bf99b7a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:36.238570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e777cdd-21dc-4af9-85c0-32757bf99b7a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:36.239442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e777cdd-21dc-4af9-85c0-32757bf99b7a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:36.239928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e777cdd-21dc-4af9-85c0-32757bf99b7a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:36.538797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3e777cdd-21dc-4af9-85c0-32757bf99b7a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:36.548718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3e777cdd-21dc-4af9-85c0-32757bf99b7a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1313 microversion: 2.1 time: 0.339326 Apr 19 03:39:36.549579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 118/232] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:36 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:36.834536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-03069a5d-8f91-4cb1-8eb3-2d35606e3d4f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:36.835656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-03069a5d-8f91-4cb1-8eb3-2d35606e3d4f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:36.844149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-03069a5d-8f91-4cb1-8eb3-2d35606e3d4f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:36.844660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-03069a5d-8f91-4cb1-8eb3-2d35606e3d4f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:36.845498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-03069a5d-8f91-4cb1-8eb3-2d35606e3d4f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:36.846006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-03069a5d-8f91-4cb1-8eb3-2d35606e3d4f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:37.015389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8313c991-7d65-42ae-bf78-52f9ff56db67 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d/os-volume_attachments/3badd6a8-41ac-43ea-9736-b322298d7571" status: 202 len: 0 microversion: 2.1 time: 1.022131 Apr 19 03:39:37.017273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 115/233] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:39:35 2021] DELETE /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d/os-volume_attachments/3badd6a8-41ac-43ea-9736-b322298d7571 => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:39:37.042549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-03069a5d-8f91-4cb1-8eb3-2d35606e3d4f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28046 microversion: 2.1 time: 0.211906 Apr 19 03:39:37.049155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 119/234] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:36 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28046 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 19 03:39:37.144422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-60ed9ea7-0988-40a3-8478-10457e9c0a50 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:37.145274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-60ed9ea7-0988-40a3-8478-10457e9c0a50 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:37.153578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60ed9ea7-0988-40a3-8478-10457e9c0a50 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:37.154357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60ed9ea7-0988-40a3-8478-10457e9c0a50 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:37.155451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60ed9ea7-0988-40a3-8478-10457e9c0a50 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:37.155938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60ed9ea7-0988-40a3-8478-10457e9c0a50 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:37.440949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-60ed9ea7-0988-40a3-8478-10457e9c0a50 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:37.451060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-60ed9ea7-0988-40a3-8478-10457e9c0a50 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.311096 Apr 19 03:39:37.451911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 116/235] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:37 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:37.568612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-85d83ff0-69ba-4fe5-bbce-4d2acea63778 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:37.569540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-85d83ff0-69ba-4fe5-bbce-4d2acea63778 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:37.578202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-85d83ff0-69ba-4fe5-bbce-4d2acea63778 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:37.578711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-85d83ff0-69ba-4fe5-bbce-4d2acea63778 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:37.579599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-85d83ff0-69ba-4fe5-bbce-4d2acea63778 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:37.580094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-85d83ff0-69ba-4fe5-bbce-4d2acea63778 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:37.849418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-85d83ff0-69ba-4fe5-bbce-4d2acea63778 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:37.862078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-85d83ff0-69ba-4fe5-bbce-4d2acea63778 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1313 microversion: 2.1 time: 0.297545 Apr 19 03:39:37.862327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 120/236] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:37 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:38.057961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3e70f057-6399-4ed1-88b2-5db4b27ff66d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:38.059203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3e70f057-6399-4ed1-88b2-5db4b27ff66d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:38.078719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e70f057-6399-4ed1-88b2-5db4b27ff66d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:38.079607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e70f057-6399-4ed1-88b2-5db4b27ff66d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:38.080737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e70f057-6399-4ed1-88b2-5db4b27ff66d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:38.084788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e70f057-6399-4ed1-88b2-5db4b27ff66d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:38.229987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3e70f057-6399-4ed1-88b2-5db4b27ff66d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28131 microversion: 2.1 time: 0.176167 Apr 19 03:39:38.230824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 117/237] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:38 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28131 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:38.470785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7c8f451d-8530-4d8c-9678-1e5ed2d47dec tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:38.480307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7c8f451d-8530-4d8c-9678-1e5ed2d47dec tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:38.480641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c8f451d-8530-4d8c-9678-1e5ed2d47dec tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:38.481186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c8f451d-8530-4d8c-9678-1e5ed2d47dec tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:38.482027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c8f451d-8530-4d8c-9678-1e5ed2d47dec tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:38.482521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c8f451d-8530-4d8c-9678-1e5ed2d47dec tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:38.804217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7c8f451d-8530-4d8c-9678-1e5ed2d47dec tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:38.821163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7c8f451d-8530-4d8c-9678-1e5ed2d47dec tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.355823 Apr 19 03:39:38.823006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 121/238] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:38 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:38.881192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-30cae1ed-6e4d-4a73-9b5f-a839b07094fb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:38.881757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-30cae1ed-6e4d-4a73-9b5f-a839b07094fb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:38.891023 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30cae1ed-6e4d-4a73-9b5f-a839b07094fb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:38.891663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30cae1ed-6e4d-4a73-9b5f-a839b07094fb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:38.892655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30cae1ed-6e4d-4a73-9b5f-a839b07094fb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:38.893230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30cae1ed-6e4d-4a73-9b5f-a839b07094fb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:39.155424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-30cae1ed-6e4d-4a73-9b5f-a839b07094fb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:39.166323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-30cae1ed-6e4d-4a73-9b5f-a839b07094fb tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1313 microversion: 2.1 time: 0.291237 Apr 19 03:39:39.169200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 118/239] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:38 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:39.245842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1565a217-dd44-447b-a8ec-ab87a6fe3abf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:39.247455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1565a217-dd44-447b-a8ec-ab87a6fe3abf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:39.255729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1565a217-dd44-447b-a8ec-ab87a6fe3abf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:39.256395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1565a217-dd44-447b-a8ec-ab87a6fe3abf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:39.257515 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1565a217-dd44-447b-a8ec-ab87a6fe3abf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:39.258309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1565a217-dd44-447b-a8ec-ab87a6fe3abf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:39.378411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1565a217-dd44-447b-a8ec-ab87a6fe3abf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28131 microversion: 2.1 time: 0.134920 Apr 19 03:39:39.378411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 122/240] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:39 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28131 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:39.679240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1029730275", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "networks": [{"uuid": "c6488502-d478-4c15-aad9-cec2dbbd6c1f"}]}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:39.773177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] validate_networks() for [('c6488502-d478-4c15-aad9-cec2dbbd6c1f', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:39:39.843315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0037ada8-e0c0-40e6-8e50-8aa10ae369e0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:39.844381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0037ada8-e0c0-40e6-8e50-8aa10ae369e0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:39.864215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0037ada8-e0c0-40e6-8e50-8aa10ae369e0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:39.866610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0037ada8-e0c0-40e6-8e50-8aa10ae369e0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:39.871206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0037ada8-e0c0-40e6-8e50-8aa10ae369e0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:39.883656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0037ada8-e0c0-40e6-8e50-8aa10ae369e0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:40.483750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0037ada8-e0c0-40e6-8e50-8aa10ae369e0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:40.501327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0037ada8-e0c0-40e6-8e50-8aa10ae369e0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.658714 Apr 19 03:39:40.516036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 123/241] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:39 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:40.528466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b70b341e-f79d-45f6-bead-65b76119db61 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:40.529980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b70b341e-f79d-45f6-bead-65b76119db61 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:40.550694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b70b341e-f79d-45f6-bead-65b76119db61 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:40.552903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b70b341e-f79d-45f6-bead-65b76119db61 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:40.554616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b70b341e-f79d-45f6-bead-65b76119db61 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:40.556949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b70b341e-f79d-45f6-bead-65b76119db61 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:40.868091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:39:40.868720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:39:40.869450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:39:40.869915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:39:40.870407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:39:40.882060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:40.882573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:40.883482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:40.883978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:40.909434 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Getting quotas for project 3a4502ef85b348a384aa26343b925024. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:39:40.916287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Getting quotas for user 7230efa31a8f47ca95af1f576f73cd90 and project 3a4502ef85b348a384aa26343b925024. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:39:40.932399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:39:40.935348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:39:41.047003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4dddfc62-083e-4590-8b80-4eae94c292f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.371311 Apr 19 03:39:41.047730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 119/242] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:39:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:39:41.060709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b997b830-8085-4223-ae94-bbea0161da0d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:41.062712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b997b830-8085-4223-ae94-bbea0161da0d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:41.076559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b997b830-8085-4223-ae94-bbea0161da0d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:41.077352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b997b830-8085-4223-ae94-bbea0161da0d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:41.078615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b997b830-8085-4223-ae94-bbea0161da0d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:41.080102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b997b830-8085-4223-ae94-bbea0161da0d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:41.153733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b70b341e-f79d-45f6-bead-65b76119db61 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:41.187527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b70b341e-f79d-45f6-bead-65b76119db61 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1313 microversion: 2.1 time: 0.650548 Apr 19 03:39:41.187527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 124/243] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:40 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1313 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:41.187527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-bf7db7b8-80b0-4713-be74-a08db9d76e97 req-6a79aefc-569a-458b-9d90-4f29805b6649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12cbafd-bf5a-464a-831a-517e91bce6df", "name": "network-vif-plugged", "status": "completed", "tag": "c68f1269-d312-4c49-81ad-d808f6473ee8"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:41.187527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:39:41.187527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:39:41.202793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-bf7db7b8-80b0-4713-be74-a08db9d76e97 req-6a79aefc-569a-458b-9d90-4f29805b6649 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:41.203176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-bf7db7b8-80b0-4713-be74-a08db9d76e97 req-6a79aefc-569a-458b-9d90-4f29805b6649 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:41.221627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-bf7db7b8-80b0-4713-be74-a08db9d76e97 req-6a79aefc-569a-458b-9d90-4f29805b6649 service nova] Creating event network-vif-plugged:c68f1269-d312-4c49-81ad-d808f6473ee8 for instance c12cbafd-bf5a-464a-831a-517e91bce6df on hv-cinder-78605 Apr 19 03:39:41.228749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-bf7db7b8-80b0-4713-be74-a08db9d76e97 req-6a79aefc-569a-458b-9d90-4f29805b6649 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049954 Apr 19 03:39:41.229803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 125/244] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:39:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:39:41.236403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-63b71ff4-aa26-4bde-94bb-7a36b1e94638 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:41.237361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-63b71ff4-aa26-4bde-94bb-7a36b1e94638 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:41.249566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b997b830-8085-4223-ae94-bbea0161da0d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28421 microversion: 2.1 time: 0.196697 Apr 19 03:39:41.250690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 120/245] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:41 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28421 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:41.392020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-63b71ff4-aa26-4bde-94bb-7a36b1e94638 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:41.416681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-63b71ff4-aa26-4bde-94bb-7a36b1e94638 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1218 microversion: 2.1 time: 0.185585 Apr 19 03:39:41.417965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 126/246] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:41 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:41.522896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-92a6bbe8-13aa-4b86-8188-9abb4f1fa18c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:41.523941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-92a6bbe8-13aa-4b86-8188-9abb4f1fa18c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:41.563303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92a6bbe8-13aa-4b86-8188-9abb4f1fa18c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:41.564291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92a6bbe8-13aa-4b86-8188-9abb4f1fa18c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:41.564852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92a6bbe8-13aa-4b86-8188-9abb4f1fa18c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:41.565347 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92a6bbe8-13aa-4b86-8188-9abb4f1fa18c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:42.008335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-92a6bbe8-13aa-4b86-8188-9abb4f1fa18c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:42.009346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-92a6bbe8-13aa-4b86-8188-9abb4f1fa18c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.491079 Apr 19 03:39:42.009968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 121/247] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:41 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:42.202261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-66ebe7bb-f8ed-413c-8005-252a4170ecd5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:42.203124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-66ebe7bb-f8ed-413c-8005-252a4170ecd5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:42.212438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66ebe7bb-f8ed-413c-8005-252a4170ecd5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:42.213208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66ebe7bb-f8ed-413c-8005-252a4170ecd5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:42.214226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66ebe7bb-f8ed-413c-8005-252a4170ecd5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:42.214897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66ebe7bb-f8ed-413c-8005-252a4170ecd5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:42.262648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e94209d7-aae2-4cbf-a1a0-8c5f1bc3a1d1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:42.264039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e94209d7-aae2-4cbf-a1a0-8c5f1bc3a1d1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:42.282614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e94209d7-aae2-4cbf-a1a0-8c5f1bc3a1d1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:42.283451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e94209d7-aae2-4cbf-a1a0-8c5f1bc3a1d1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:42.286285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e94209d7-aae2-4cbf-a1a0-8c5f1bc3a1d1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:42.287317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e94209d7-aae2-4cbf-a1a0-8c5f1bc3a1d1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:42.565136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-66ebe7bb-f8ed-413c-8005-252a4170ecd5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:42.575095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-66ebe7bb-f8ed-413c-8005-252a4170ecd5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1313 microversion: 2.1 time: 0.376925 Apr 19 03:39:42.578657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 127/248] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:42 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:42.582128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-49c1c9c8-03a6-41c9-a3a1-4aaf5dc7cb33 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:42.583338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-49c1c9c8-03a6-41c9-a3a1-4aaf5dc7cb33 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:42.590175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e94209d7-aae2-4cbf-a1a0-8c5f1bc3a1d1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28587 microversion: 2.1 time: 0.331668 Apr 19 03:39:42.596492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 122/249] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:42 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28587 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:42.603261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49c1c9c8-03a6-41c9-a3a1-4aaf5dc7cb33 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:42.604003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49c1c9c8-03a6-41c9-a3a1-4aaf5dc7cb33 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:42.607411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49c1c9c8-03a6-41c9-a3a1-4aaf5dc7cb33 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:42.607411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49c1c9c8-03a6-41c9-a3a1-4aaf5dc7cb33 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:42.954998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-49c1c9c8-03a6-41c9-a3a1-4aaf5dc7cb33 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:42.971249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-49c1c9c8-03a6-41c9-a3a1-4aaf5dc7cb33 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1214 microversion: 2.1 time: 0.393255 Apr 19 03:39:42.971889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 128/250] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:42 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1214 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:43.028948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cceff285-2a4c-468b-8072-b62a6b195e91 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:43.030311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cceff285-2a4c-468b-8072-b62a6b195e91 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:43.056785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cceff285-2a4c-468b-8072-b62a6b195e91 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:43.060459 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cceff285-2a4c-468b-8072-b62a6b195e91 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:43.061492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cceff285-2a4c-468b-8072-b62a6b195e91 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:43.063721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cceff285-2a4c-468b-8072-b62a6b195e91 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:43.595025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-44ce314e-c905-4eb4-aa79-188b5a1d5fea tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:43.595025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-44ce314e-c905-4eb4-aa79-188b5a1d5fea tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:43.616814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44ce314e-c905-4eb4-aa79-188b5a1d5fea tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:43.617356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44ce314e-c905-4eb4-aa79-188b5a1d5fea tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:43.618151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44ce314e-c905-4eb4-aa79-188b5a1d5fea tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:43.620318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44ce314e-c905-4eb4-aa79-188b5a1d5fea tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:43.710327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cceff285-2a4c-468b-8072-b62a6b195e91 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:43.737529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cceff285-2a4c-468b-8072-b62a6b195e91 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.713564 Apr 19 03:39:43.739713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 123/251] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:43 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:43.752594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-091567d7-eac7-4ae4-a11c-9ebc14ae0e7a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:43.753931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-091567d7-eac7-4ae4-a11c-9ebc14ae0e7a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:43.764116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-091567d7-eac7-4ae4-a11c-9ebc14ae0e7a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:43.765071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-091567d7-eac7-4ae4-a11c-9ebc14ae0e7a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:43.766140 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-091567d7-eac7-4ae4-a11c-9ebc14ae0e7a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:43.766823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-091567d7-eac7-4ae4-a11c-9ebc14ae0e7a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:43.913966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-091567d7-eac7-4ae4-a11c-9ebc14ae0e7a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28587 microversion: 2.1 time: 0.172222 Apr 19 03:39:43.918180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 124/252] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:43 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28587 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:43.992035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c32b92b5-cf04-4d3a-889b-68c120b7731f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:43.992035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c32b92b5-cf04-4d3a-889b-68c120b7731f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:44.007457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c32b92b5-cf04-4d3a-889b-68c120b7731f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:44.014442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c32b92b5-cf04-4d3a-889b-68c120b7731f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:44.017084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c32b92b5-cf04-4d3a-889b-68c120b7731f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:44.018765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c32b92b5-cf04-4d3a-889b-68c120b7731f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:44.419000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c32b92b5-cf04-4d3a-889b-68c120b7731f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:44.432701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c32b92b5-cf04-4d3a-889b-68c120b7731f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1288 microversion: 2.1 time: 0.446797 Apr 19 03:39:44.434928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 125/253] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:43 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1288 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:44.538558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-44ce314e-c905-4eb4-aa79-188b5a1d5fea tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:44.571531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-44ce314e-c905-4eb4-aa79-188b5a1d5fea tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1497 microversion: 2.1 time: 0.981960 Apr 19 03:39:44.572497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 129/254] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:43 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1497 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:44.756870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-70d3f434-80bb-434e-ab29-5a79922de170 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:44.757550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-70d3f434-80bb-434e-ab29-5a79922de170 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:44.767925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70d3f434-80bb-434e-ab29-5a79922de170 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:44.769330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70d3f434-80bb-434e-ab29-5a79922de170 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:44.771207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70d3f434-80bb-434e-ab29-5a79922de170 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:44.771963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70d3f434-80bb-434e-ab29-5a79922de170 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:44.927698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ce01b193-6d2a-4da8-9ba7-3565e48b79b5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:44.928842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ce01b193-6d2a-4da8-9ba7-3565e48b79b5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:44.939897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce01b193-6d2a-4da8-9ba7-3565e48b79b5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:44.949019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce01b193-6d2a-4da8-9ba7-3565e48b79b5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:44.949019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce01b193-6d2a-4da8-9ba7-3565e48b79b5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:44.949835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce01b193-6d2a-4da8-9ba7-3565e48b79b5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:45.150152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ce01b193-6d2a-4da8-9ba7-3565e48b79b5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28587 microversion: 2.1 time: 0.227465 Apr 19 03:39:45.151885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 130/255] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:44 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28587 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:45.282655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-70d3f434-80bb-434e-ab29-5a79922de170 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:45.306374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-70d3f434-80bb-434e-ab29-5a79922de170 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1519 microversion: 2.1 time: 0.549801 Apr 19 03:39:45.308443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 126/256] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:44 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1519 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:45.453840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e1e9e3d1-fd11-4137-a1dc-382575d52d5f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:45.454621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e1e9e3d1-fd11-4137-a1dc-382575d52d5f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:45.474833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1e9e3d1-fd11-4137-a1dc-382575d52d5f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:45.475395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1e9e3d1-fd11-4137-a1dc-382575d52d5f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:45.476263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1e9e3d1-fd11-4137-a1dc-382575d52d5f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:45.476760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1e9e3d1-fd11-4137-a1dc-382575d52d5f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:45.746516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e1e9e3d1-fd11-4137-a1dc-382575d52d5f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:45.775473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e1e9e3d1-fd11-4137-a1dc-382575d52d5f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1276 microversion: 2.1 time: 0.326855 Apr 19 03:39:45.780077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 131/257] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:45 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1276 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:45.917237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-76184a3e-8845-4898-9753-9b73e4e3c2d5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:45.922304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-76184a3e-8845-4898-9753-9b73e4e3c2d5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:45.929860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76184a3e-8845-4898-9753-9b73e4e3c2d5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:45.933866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76184a3e-8845-4898-9753-9b73e4e3c2d5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:45.935058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76184a3e-8845-4898-9753-9b73e4e3c2d5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:45.942247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76184a3e-8845-4898-9753-9b73e4e3c2d5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:46.047032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-76184a3e-8845-4898-9753-9b73e4e3c2d5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:39:46.162368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-39f31bca-fd37-4394-8079-9a437b1fc1d0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:46.163418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-39f31bca-fd37-4394-8079-9a437b1fc1d0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:46.182836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-39f31bca-fd37-4394-8079-9a437b1fc1d0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:46.183384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-39f31bca-fd37-4394-8079-9a437b1fc1d0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:46.184753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-39f31bca-fd37-4394-8079-9a437b1fc1d0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:46.185321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-39f31bca-fd37-4394-8079-9a437b1fc1d0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:46.342057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-76184a3e-8845-4898-9753-9b73e4e3c2d5 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 204 len: 0 microversion: 2.1 time: 0.428617 Apr 19 03:39:46.342681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 127/258] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:39:45 2021] DELETE /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:39:46.350410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-39f31bca-fd37-4394-8079-9a437b1fc1d0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28587 microversion: 2.1 time: 0.191917 Apr 19 03:39:46.353356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 132/259] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:46 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28587 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:46.361528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2523fdae-fe05-47a2-948c-670adcb7ead9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:46.362556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2523fdae-fe05-47a2-948c-670adcb7ead9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:46.366202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5d0fc72d-7ced-4e38-85a5-b036f57bbffa tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:46.371202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5d0fc72d-7ced-4e38-85a5-b036f57bbffa tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:46.389744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2523fdae-fe05-47a2-948c-670adcb7ead9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:46.390138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2523fdae-fe05-47a2-948c-670adcb7ead9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:46.391431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2523fdae-fe05-47a2-948c-670adcb7ead9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:46.392563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2523fdae-fe05-47a2-948c-670adcb7ead9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:46.398197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5d0fc72d-7ced-4e38-85a5-b036f57bbffa tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:46.403512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5d0fc72d-7ced-4e38-85a5-b036f57bbffa tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:46.406525 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5d0fc72d-7ced-4e38-85a5-b036f57bbffa tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:46.407275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5d0fc72d-7ced-4e38-85a5-b036f57bbffa tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:47.032728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5d0fc72d-7ced-4e38-85a5-b036f57bbffa tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:47.056885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5d0fc72d-7ced-4e38-85a5-b036f57bbffa tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1503 microversion: 2.1 time: 0.691865 Apr 19 03:39:47.058867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 133/260] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:46 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1503 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:47.071882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b2380fe6-3696-44ec-8d92-a54099a86b24 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:47.075645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b2380fe6-3696-44ec-8d92-a54099a86b24 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:47.088291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2380fe6-3696-44ec-8d92-a54099a86b24 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:47.089689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2380fe6-3696-44ec-8d92-a54099a86b24 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:47.096035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2380fe6-3696-44ec-8d92-a54099a86b24 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:47.096658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2380fe6-3696-44ec-8d92-a54099a86b24 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:47.390630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2523fdae-fe05-47a2-948c-670adcb7ead9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:47.417494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2523fdae-fe05-47a2-948c-670adcb7ead9 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1499 microversion: 2.1 time: 1.073016 Apr 19 03:39:47.422111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 128/261] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:46 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1499 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:47.445363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-310ad710-9fb8-413a-93c8-19a7f9045695 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:47.455766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-310ad710-9fb8-413a-93c8-19a7f9045695 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:47.482071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-310ad710-9fb8-413a-93c8-19a7f9045695 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:47.482895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-310ad710-9fb8-413a-93c8-19a7f9045695 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:47.484686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-310ad710-9fb8-413a-93c8-19a7f9045695 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:47.485385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-310ad710-9fb8-413a-93c8-19a7f9045695 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:47.558822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b2380fe6-3696-44ec-8d92-a54099a86b24 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:47.580339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b2380fe6-3696-44ec-8d92-a54099a86b24 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1318 microversion: 2.1 time: 0.519031 Apr 19 03:39:47.581166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 134/262] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:47 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:47.597419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d5d3436f-f918-420e-830a-47d24f1f21e5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:47.598095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d5d3436f-f918-420e-830a-47d24f1f21e5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:47.617406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5d3436f-f918-420e-830a-47d24f1f21e5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:47.618130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5d3436f-f918-420e-830a-47d24f1f21e5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:47.619932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5d3436f-f918-420e-830a-47d24f1f21e5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:47.620465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5d3436f-f918-420e-830a-47d24f1f21e5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:47.691665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-310ad710-9fb8-413a-93c8-19a7f9045695 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28587 microversion: 2.1 time: 0.261154 Apr 19 03:39:47.692345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 129/263] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:47 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28587 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:48.054472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d5d3436f-f918-420e-830a-47d24f1f21e5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:48.073887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d5d3436f-f918-420e-830a-47d24f1f21e5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1515 microversion: 2.1 time: 0.482839 Apr 19 03:39:48.074712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 135/264] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:47 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1515 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:48.077150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3f3d80e3-afa8-4644-a598-9325126cd66f tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:48.078338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3f3d80e3-afa8-4644-a598-9325126cd66f tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:48.093659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f3d80e3-afa8-4644-a598-9325126cd66f tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:48.094261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f3d80e3-afa8-4644-a598-9325126cd66f tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:48.095250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f3d80e3-afa8-4644-a598-9325126cd66f tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:48.096189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f3d80e3-afa8-4644-a598-9325126cd66f tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:48.598309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dbbbd034-4345-415e-afbf-3c8e65a07cb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:48.599748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dbbbd034-4345-415e-afbf-3c8e65a07cb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:48.612729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbbbd034-4345-415e-afbf-3c8e65a07cb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:48.615635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbbbd034-4345-415e-afbf-3c8e65a07cb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:48.617485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbbbd034-4345-415e-afbf-3c8e65a07cb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:48.626384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbbbd034-4345-415e-afbf-3c8e65a07cb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:48.825738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3f3d80e3-afa8-4644-a598-9325126cd66f tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:48.859975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3f3d80e3-afa8-4644-a598-9325126cd66f tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1503 microversion: 2.1 time: 0.785909 Apr 19 03:39:48.873451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 130/265] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:48 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1503 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:48.879059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-18de392e-f838-4ac6-82f8-450653af0d43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:48.881779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-18de392e-f838-4ac6-82f8-450653af0d43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:48.897094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-18de392e-f838-4ac6-82f8-450653af0d43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:48.897916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-18de392e-f838-4ac6-82f8-450653af0d43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:48.898994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-18de392e-f838-4ac6-82f8-450653af0d43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:48.899748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-18de392e-f838-4ac6-82f8-450653af0d43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:49.088709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-18de392e-f838-4ac6-82f8-450653af0d43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28587 microversion: 2.1 time: 0.213248 Apr 19 03:39:49.089796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 131/266] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:48 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28587 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:49.311182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-9331d21d-011a-4f28-bd47-5c67986e011d req-59cbb419-e179-4bf7-9208-be05cd3e2e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22be386b-f516-47e4-8c1a-4ceadfb6af9b", "tag": "7f73b7d8-7f40-4b4b-8ce9-0712f3b4e188"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:49.312994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:39:49.312994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:39:49.341917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-9331d21d-011a-4f28-bd47-5c67986e011d req-59cbb419-e179-4bf7-9208-be05cd3e2e8a service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:49.342414 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-9331d21d-011a-4f28-bd47-5c67986e011d req-59cbb419-e179-4bf7-9208-be05cd3e2e8a service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:49.407647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-9331d21d-011a-4f28-bd47-5c67986e011d req-59cbb419-e179-4bf7-9208-be05cd3e2e8a service nova] Creating event network-changed:7f73b7d8-7f40-4b4b-8ce9-0712f3b4e188 for instance 22be386b-f516-47e4-8c1a-4ceadfb6af9b on hv-cinder-78605 Apr 19 03:39:49.413961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-9331d21d-011a-4f28-bd47-5c67986e011d req-59cbb419-e179-4bf7-9208-be05cd3e2e8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108930 Apr 19 03:39:49.418030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 132/267] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:39:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:39:49.885940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a7885776-1089-4bc8-9a38-439549b12125 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:49.888223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a7885776-1089-4bc8-9a38-439549b12125 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:49.898707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7885776-1089-4bc8-9a38-439549b12125 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:49.899898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7885776-1089-4bc8-9a38-439549b12125 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:49.901137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7885776-1089-4bc8-9a38-439549b12125 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:49.902303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7885776-1089-4bc8-9a38-439549b12125 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:49.989873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dbbbd034-4345-415e-afbf-3c8e65a07cb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:50.001237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dbbbd034-4345-415e-afbf-3c8e65a07cb1 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1318 microversion: 2.1 time: 1.406994 Apr 19 03:39:50.001880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 136/268] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:48 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1318 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:39:50.101640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-07784ef1-bcef-472e-9253-32a36ac24de6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:50.103471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-07784ef1-bcef-472e-9253-32a36ac24de6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:50.130033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-07784ef1-bcef-472e-9253-32a36ac24de6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:50.130787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-07784ef1-bcef-472e-9253-32a36ac24de6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:50.131844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-07784ef1-bcef-472e-9253-32a36ac24de6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:50.132481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-07784ef1-bcef-472e-9253-32a36ac24de6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:50.315978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a7885776-1089-4bc8-9a38-439549b12125 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:50.330206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a7885776-1089-4bc8-9a38-439549b12125 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1503 microversion: 2.1 time: 0.451220 Apr 19 03:39:50.343469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 133/269] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:49 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1503 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:50.362302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3fd99054-d147-4a2a-a5d5-9f79fd99156d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:50.363409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3fd99054-d147-4a2a-a5d5-9f79fd99156d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:50.377025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd99054-d147-4a2a-a5d5-9f79fd99156d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:50.377538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd99054-d147-4a2a-a5d5-9f79fd99156d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:50.378386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd99054-d147-4a2a-a5d5-9f79fd99156d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:50.378874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd99054-d147-4a2a-a5d5-9f79fd99156d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:50.402453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-07784ef1-bcef-472e-9253-32a36ac24de6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 28722 microversion: 2.1 time: 0.305006 Apr 19 03:39:50.404273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 137/270] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:50 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 28722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:50.522327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-3fd99054-d147-4a2a-a5d5-9f79fd99156d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lazy-loading 'flavor' on Instance uuid 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:39:50.958898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3fd99054-d147-4a2a-a5d5-9f79fd99156d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/action" status: 200 len: 32 microversion: 2.1 time: 0.601843 Apr 19 03:39:50.959647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 134/271] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:50 2021] POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/action => generated 32 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 19 03:39:50.970524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0ad37e24-7319-4d6e-9204-ff6a947b00c1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:50.971644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0ad37e24-7319-4d6e-9204-ff6a947b00c1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:50.999228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ad37e24-7319-4d6e-9204-ff6a947b00c1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:51.004228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ad37e24-7319-4d6e-9204-ff6a947b00c1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:51.005121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ad37e24-7319-4d6e-9204-ff6a947b00c1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:51.005606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ad37e24-7319-4d6e-9204-ff6a947b00c1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:51.019681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3b95c0e7-76c4-4afa-ad84-23c25329fe3f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:51.020791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3b95c0e7-76c4-4afa-ad84-23c25329fe3f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:51.045299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b95c0e7-76c4-4afa-ad84-23c25329fe3f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:51.045814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b95c0e7-76c4-4afa-ad84-23c25329fe3f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:51.054872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b95c0e7-76c4-4afa-ad84-23c25329fe3f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:51.054872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b95c0e7-76c4-4afa-ad84-23c25329fe3f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:51.685183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0ad37e24-7319-4d6e-9204-ff6a947b00c1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:51.698704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0ad37e24-7319-4d6e-9204-ff6a947b00c1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.733239 Apr 19 03:39:51.709351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 138/272] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:50 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:51.713946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b2cbe160-d3e9-4933-b6f5-20227ee4eef0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:51.714308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b2cbe160-d3e9-4933-b6f5-20227ee4eef0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:51.732754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2cbe160-d3e9-4933-b6f5-20227ee4eef0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:51.733265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2cbe160-d3e9-4933-b6f5-20227ee4eef0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:51.734274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2cbe160-d3e9-4933-b6f5-20227ee4eef0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:51.734634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2cbe160-d3e9-4933-b6f5-20227ee4eef0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:52.021999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b2cbe160-d3e9-4933-b6f5-20227ee4eef0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:52.037139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b2cbe160-d3e9-4933-b6f5-20227ee4eef0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1461 microversion: 2.1 time: 0.335838 Apr 19 03:39:52.041295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 139/273] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:51 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1461 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:52.056845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1e99d06c-bba9-453c-a099-26646eb05666 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:52.061568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1e99d06c-bba9-453c-a099-26646eb05666 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:52.080824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e99d06c-bba9-453c-a099-26646eb05666 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:52.081570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e99d06c-bba9-453c-a099-26646eb05666 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:52.089339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e99d06c-bba9-453c-a099-26646eb05666 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:52.090051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e99d06c-bba9-453c-a099-26646eb05666 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:52.329805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1e99d06c-bba9-453c-a099-26646eb05666 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 31866 microversion: 2.1 time: 0.285675 Apr 19 03:39:52.335542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 140/274] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:52 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 31866 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:52.343066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-094ad347-1fc5-45f8-975b-52c562c9c0cf req-2c0793d0-cfed-49a0-94f0-6fa4bb07d4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12cbafd-bf5a-464a-831a-517e91bce6df", "name": "network-vif-deleted", "tag": "c68f1269-d312-4c49-81ad-d808f6473ee8"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:52.345735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:39:52.345735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:39:52.358118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-094ad347-1fc5-45f8-975b-52c562c9c0cf req-2c0793d0-cfed-49a0-94f0-6fa4bb07d4da service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:52.358886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-094ad347-1fc5-45f8-975b-52c562c9c0cf req-2c0793d0-cfed-49a0-94f0-6fa4bb07d4da service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:52.388166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-094ad347-1fc5-45f8-975b-52c562c9c0cf req-2c0793d0-cfed-49a0-94f0-6fa4bb07d4da service nova] Creating event network-vif-deleted:c68f1269-d312-4c49-81ad-d808f6473ee8 for instance c12cbafd-bf5a-464a-831a-517e91bce6df on hv-cinder-78605 Apr 19 03:39:52.388421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-094ad347-1fc5-45f8-975b-52c562c9c0cf req-2c0793d0-cfed-49a0-94f0-6fa4bb07d4da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049810 Apr 19 03:39:52.389472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 141/275] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:39:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:39:52.429945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3b95c0e7-76c4-4afa-ad84-23c25329fe3f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:52.454179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3b95c0e7-76c4-4afa-ad84-23c25329fe3f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1318 microversion: 2.1 time: 1.439775 Apr 19 03:39:52.455125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 135/276] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:51 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1318 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:52.718556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-775c0393-acd9-42f4-b58e-1be667c29f2d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:52.719494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-775c0393-acd9-42f4-b58e-1be667c29f2d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:52.728177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-775c0393-acd9-42f4-b58e-1be667c29f2d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:52.728792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-775c0393-acd9-42f4-b58e-1be667c29f2d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:52.729715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-775c0393-acd9-42f4-b58e-1be667c29f2d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:52.730285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-775c0393-acd9-42f4-b58e-1be667c29f2d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:53.059263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:53.060205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:53.070286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:53.071024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:53.072576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:53.073270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:53.179192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:53.179817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:53.180431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lazy-loading 'fault' on Instance uuid c12cbafd-bf5a-464a-831a-517e91bce6df {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:39:53.351711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:53.361681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8dcecdf2-482a-435c-83f5-294994b4180c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1303 microversion: 2.1 time: 0.306824 Apr 19 03:39:53.362523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 136/277] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:53 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1303 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:53.378779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8a546cfc-6d22-4cf6-8b3e-4390103cff61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:53.380490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8a546cfc-6d22-4cf6-8b3e-4390103cff61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:53.401755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a546cfc-6d22-4cf6-8b3e-4390103cff61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:53.402243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a546cfc-6d22-4cf6-8b3e-4390103cff61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:53.419646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a546cfc-6d22-4cf6-8b3e-4390103cff61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:53.420191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a546cfc-6d22-4cf6-8b3e-4390103cff61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:53.447607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-775c0393-acd9-42f4-b58e-1be667c29f2d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:53.460640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-775c0393-acd9-42f4-b58e-1be667c29f2d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.746960 Apr 19 03:39:53.467357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 142/278] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:52 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:53.473094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e806b195-0265-4fbe-be89-98bbd5ae97f0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:53.487897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e806b195-0265-4fbe-be89-98bbd5ae97f0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:53.503206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e806b195-0265-4fbe-be89-98bbd5ae97f0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:53.503757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e806b195-0265-4fbe-be89-98bbd5ae97f0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:53.504629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e806b195-0265-4fbe-be89-98bbd5ae97f0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:53.505220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e806b195-0265-4fbe-be89-98bbd5ae97f0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:54.166804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e806b195-0265-4fbe-be89-98bbd5ae97f0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:54.176921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e806b195-0265-4fbe-be89-98bbd5ae97f0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1318 microversion: 2.1 time: 0.708122 Apr 19 03:39:54.177576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 143/279] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:53 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:54.487442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7ad4b0fc-d021-481b-ba6c-4a28f7429f78 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'create', calling method: .version_select at 0x7f9dac19dc80>, body: {"keypair": {"name": "tempest-keypair-174935788"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:54.511602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-7ad4b0fc-d021-481b-ba6c-4a28f7429f78 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for project a1596875092a4918b57b2ca36f54fbd0. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:39:54.516049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-7ad4b0fc-d021-481b-ba6c-4a28f7429f78 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for user 4c276e843fab41419f611a5dd2adc9e8 and project a1596875092a4918b57b2ca36f54fbd0. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:39:54.714952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-7ad4b0fc-d021-481b-ba6c-4a28f7429f78 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for project a1596875092a4918b57b2ca36f54fbd0. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:39:54.719389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-7ad4b0fc-d021-481b-ba6c-4a28f7429f78 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for user 4c276e843fab41419f611a5dd2adc9e8 and project a1596875092a4918b57b2ca36f54fbd0. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:39:54.733528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7ad4b0fc-d021-481b-ba6c-4a28f7429f78 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.390986 Apr 19 03:39:54.734375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 144/280] 10.222.0.25 () {62 vars in 1189 bytes} [Mon Apr 19 03:39:54 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 392 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 19 03:39:54.739530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:54.740205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:54.751129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:54.751129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:54.751129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:54.751522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:54.835923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:54.836383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:54.836906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lazy-loading 'fault' on Instance uuid c12cbafd-bf5a-464a-831a-517e91bce6df {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:39:54.982084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:54.993212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a0801a4f-3b20-4308-8c0b-dd900a19dea2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1303 microversion: 2.1 time: 0.257299 Apr 19 03:39:54.993856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 145/281] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:54 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1303 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:54.999164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6ccc796f-569c-4c05-b36b-8dfc5d503f3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:54.999831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6ccc796f-569c-4c05-b36b-8dfc5d503f3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:55.008452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ccc796f-569c-4c05-b36b-8dfc5d503f3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:55.008843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ccc796f-569c-4c05-b36b-8dfc5d503f3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:55.009696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ccc796f-569c-4c05-b36b-8dfc5d503f3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:55.010187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ccc796f-569c-4c05-b36b-8dfc5d503f3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:55.271427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6ccc796f-569c-4c05-b36b-8dfc5d503f3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:55.282550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6ccc796f-569c-4c05-b36b-8dfc5d503f3c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.287403 Apr 19 03:39:55.283498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 146/282] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:54 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:55.300173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-43e15bcd-2004-48f7-97e3-0b4ed40f28dc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:55.300854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-43e15bcd-2004-48f7-97e3-0b4ed40f28dc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:55.309309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-43e15bcd-2004-48f7-97e3-0b4ed40f28dc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:55.309972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-43e15bcd-2004-48f7-97e3-0b4ed40f28dc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:55.310822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-43e15bcd-2004-48f7-97e3-0b4ed40f28dc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:55.311344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-43e15bcd-2004-48f7-97e3-0b4ed40f28dc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:55.593966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-43e15bcd-2004-48f7-97e3-0b4ed40f28dc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:55.615170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-43e15bcd-2004-48f7-97e3-0b4ed40f28dc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1318 microversion: 2.1 time: 0.319211 Apr 19 03:39:55.616258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 147/283] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:55 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:55.913291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8a546cfc-6d22-4cf6-8b3e-4390103cff61 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 34668 microversion: 2.1 time: 2.549184 Apr 19 03:39:55.914011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 137/284] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:53 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 34668 bytes in 2551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:56.010677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:56.011596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:56.025672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:56.037183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:56.038750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:56.039813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:56.198548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:56.199826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:56.200582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lazy-loading 'fault' on Instance uuid c12cbafd-bf5a-464a-831a-517e91bce6df {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:39:56.274268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:56.287217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0ce2ead6-46fc-4598-b99c-ba520710f695 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 200 len: 1303 microversion: 2.1 time: 0.279722 Apr 19 03:39:56.287217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 148/285] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:56 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 1303 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:56.306845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ea7e6f63-50f7-49df-8c64-212cb5307106 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:56.308153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ea7e6f63-50f7-49df-8c64-212cb5307106 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:56.320065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea7e6f63-50f7-49df-8c64-212cb5307106 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:56.321288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea7e6f63-50f7-49df-8c64-212cb5307106 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:56.322326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea7e6f63-50f7-49df-8c64-212cb5307106 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:56.322976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea7e6f63-50f7-49df-8c64-212cb5307106 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:56.636613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0d311bcb-6a28-4836-84d3-7edd2eafbfcf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:56.644583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0d311bcb-6a28-4836-84d3-7edd2eafbfcf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:56.650368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d311bcb-6a28-4836-84d3-7edd2eafbfcf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:56.651110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d311bcb-6a28-4836-84d3-7edd2eafbfcf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:56.652214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d311bcb-6a28-4836-84d3-7edd2eafbfcf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:56.652954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d311bcb-6a28-4836-84d3-7edd2eafbfcf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:56.949194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea7e6f63-50f7-49df-8c64-212cb5307106 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:56.964396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ea7e6f63-50f7-49df-8c64-212cb5307106 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.663815 Apr 19 03:39:56.966352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 138/286] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:56 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:56.977205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-56657f0c-6f54-404a-a617-f9b58bcd0b15 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:56.981096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-56657f0c-6f54-404a-a617-f9b58bcd0b15 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:57.000448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56657f0c-6f54-404a-a617-f9b58bcd0b15 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:57.005155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56657f0c-6f54-404a-a617-f9b58bcd0b15 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:57.006279 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56657f0c-6f54-404a-a617-f9b58bcd0b15 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:57.006652 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0d311bcb-6a28-4836-84d3-7edd2eafbfcf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:57.012693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56657f0c-6f54-404a-a617-f9b58bcd0b15 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:57.016393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0d311bcb-6a28-4836-84d3-7edd2eafbfcf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1318 microversion: 2.1 time: 0.385983 Apr 19 03:39:57.018283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 149/287] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:56 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:57.155417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-56657f0c-6f54-404a-a617-f9b58bcd0b15 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 35333 microversion: 2.1 time: 0.187181 Apr 19 03:39:57.156115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 139/288] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:56 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 35333 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:57.306218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-78a11772-fea6-4b5e-8c42-dfab820f68d6 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:57.306877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-78a11772-fea6-4b5e-8c42-dfab820f68d6 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: c12cbafd-bf5a-464a-831a-517e91bce6df] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:57.330660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-78a11772-fea6-4b5e-8c42-dfab820f68d6 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:57.330660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-78a11772-fea6-4b5e-8c42-dfab820f68d6 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:57.330660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-78a11772-fea6-4b5e-8c42-dfab820f68d6 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:57.330660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-78a11772-fea6-4b5e-8c42-dfab820f68d6 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:57.473814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-78a11772-fea6-4b5e-8c42-dfab820f68d6 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] HTTP exception thrown: Instance c12cbafd-bf5a-464a-831a-517e91bce6df could not be found. Apr 19 03:39:57.474729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-78a11772-fea6-4b5e-8c42-dfab820f68d6 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Returning 404 to user: Instance c12cbafd-bf5a-464a-831a-517e91bce6df could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:39:57.476033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-78a11772-fea6-4b5e-8c42-dfab820f68d6 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df" status: 404 len: 111 microversion: 2.1 time: 0.173887 Apr 19 03:39:57.482124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 150/289] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:57 2021] GET /compute/v2.1/servers/c12cbafd-bf5a-464a-831a-517e91bce6df => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:39:57.711892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-208057593", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "networks": [{"uuid": "cc00f79a-6e4b-4341-acaa-ebb6b4fd13e5"}]}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:57.841331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] validate_networks() for [('cc00f79a-6e4b-4341-acaa-ebb6b4fd13e5', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:39:57.983934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8ecfaa6b-84af-45f4-9f81-4d45af422fbb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:57.985318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8ecfaa6b-84af-45f4-9f81-4d45af422fbb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:58.006768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ecfaa6b-84af-45f4-9f81-4d45af422fbb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:58.007386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ecfaa6b-84af-45f4-9f81-4d45af422fbb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:58.008415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ecfaa6b-84af-45f4-9f81-4d45af422fbb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:58.008914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ecfaa6b-84af-45f4-9f81-4d45af422fbb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:58.399444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8ecfaa6b-84af-45f4-9f81-4d45af422fbb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:58.412307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8ecfaa6b-84af-45f4-9f81-4d45af422fbb tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.432902 Apr 19 03:39:58.413112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 151/290] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:57 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:58.429545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-51a65231-eaaa-4101-a427-3d5d7b0a1de3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:58.430420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-51a65231-eaaa-4101-a427-3d5d7b0a1de3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:58.440007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-51a65231-eaaa-4101-a427-3d5d7b0a1de3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:58.440871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-51a65231-eaaa-4101-a427-3d5d7b0a1de3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:58.445332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-51a65231-eaaa-4101-a427-3d5d7b0a1de3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:58.445332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-51a65231-eaaa-4101-a427-3d5d7b0a1de3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:58.730291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:39:58.731435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:39:58.731982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:39:58.732440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:39:58.732898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:39:58.742285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:58.742990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:58.744072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:58.744704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:58.768575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Getting quotas for project f3d298f017a843b39a22bd94f3bcfdd1. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:39:58.775990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Getting quotas for user 9d286fb2597d4c10ab08f6317b3a9046 and project f3d298f017a843b39a22bd94f3bcfdd1. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:39:58.788129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:39:58.792095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:39:58.887549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-51a65231-eaaa-4101-a427-3d5d7b0a1de3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:58.903907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-51a65231-eaaa-4101-a427-3d5d7b0a1de3 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1318 microversion: 2.1 time: 0.478291 Apr 19 03:39:58.913978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 152/291] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:58 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:58.914136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ba98fb1c-e999-4b75-9e89-f477c7a581fc tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202551 Apr 19 03:39:58.914136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 140/292] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:39:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:39:58.919525 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-db20e11a-47c9-4390-83c4-45db997d57f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:58.920080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-db20e11a-47c9-4390-83c4-45db997d57f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:58.926614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-512bc81e-0de5-4bf1-9dd5-71d98657a7e9 req-36e51e6d-65fc-4a92-97e3-9302e8e8340b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22be386b-f516-47e4-8c1a-4ceadfb6af9b", "name": "network-vif-plugged", "status": "completed", "tag": "7f73b7d8-7f40-4b4b-8ce9-0712f3b4e188"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:58.934741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db20e11a-47c9-4390-83c4-45db997d57f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:58.940226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db20e11a-47c9-4390-83c4-45db997d57f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:58.941209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db20e11a-47c9-4390-83c4-45db997d57f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:58.941722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db20e11a-47c9-4390-83c4-45db997d57f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:58.941831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:39:58.941831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:39:58.955183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-512bc81e-0de5-4bf1-9dd5-71d98657a7e9 req-36e51e6d-65fc-4a92-97e3-9302e8e8340b service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:58.955725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-512bc81e-0de5-4bf1-9dd5-71d98657a7e9 req-36e51e6d-65fc-4a92-97e3-9302e8e8340b service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:58.984206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-512bc81e-0de5-4bf1-9dd5-71d98657a7e9 req-36e51e6d-65fc-4a92-97e3-9302e8e8340b service nova] Creating event network-vif-plugged:7f73b7d8-7f40-4b4b-8ce9-0712f3b4e188 for instance 22be386b-f516-47e4-8c1a-4ceadfb6af9b on hv-cinder-78605 Apr 19 03:39:58.990724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-512bc81e-0de5-4bf1-9dd5-71d98657a7e9 req-36e51e6d-65fc-4a92-97e3-9302e8e8340b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077906 Apr 19 03:39:58.993984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 141/293] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:39:59.001265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1553575888", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9d39e32-f5f0-4d22-949b-73f3b0f4b690"}], "security_groups": [{"name": "tempest-securitygroup--1865753422"}], "key_name": "tempest-keypair-174935788", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:39:59.094136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-db20e11a-47c9-4390-83c4-45db997d57f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 36795 microversion: 2.1 time: 0.187685 Apr 19 03:39:59.112039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 153/294] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:39:58 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 36795 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:39:59.112039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4af40bf8-6c8c-4194-9e65-ab3cc66bad2c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:59.112039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4af40bf8-6c8c-4194-9e65-ab3cc66bad2c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:59.234109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4af40bf8-6c8c-4194-9e65-ab3cc66bad2c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:59.243768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4af40bf8-6c8c-4194-9e65-ab3cc66bad2c tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1213 microversion: 2.1 time: 0.142022 Apr 19 03:39:59.253966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 154/295] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:59 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:39:59.344321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] validate_networks() for [('a9d39e32-f5f0-4d22-949b-73f3b0f4b690', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:39:59.438396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d7a39d56-1772-4eee-9be5-221f0335c7b7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:39:59.438396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d7a39d56-1772-4eee-9be5-221f0335c7b7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:39:59.465899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7a39d56-1772-4eee-9be5-221f0335c7b7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:59.467801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7a39d56-1772-4eee-9be5-221f0335c7b7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:59.468966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7a39d56-1772-4eee-9be5-221f0335c7b7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:39:59.469769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7a39d56-1772-4eee-9be5-221f0335c7b7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:39:59.981648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d7a39d56-1772-4eee-9be5-221f0335c7b7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:39:59.996123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d7a39d56-1772-4eee-9be5-221f0335c7b7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.566182 Apr 19 03:39:59.997079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 155/296] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:59 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:00.001941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ddf26e86-2cfe-45df-bfcc-1db7fe9406ad tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:00.002613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ddf26e86-2cfe-45df-bfcc-1db7fe9406ad tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:00.025711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ddf26e86-2cfe-45df-bfcc-1db7fe9406ad tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:00.035837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ddf26e86-2cfe-45df-bfcc-1db7fe9406ad tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:00.037232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ddf26e86-2cfe-45df-bfcc-1db7fe9406ad tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:00.037946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ddf26e86-2cfe-45df-bfcc-1db7fe9406ad tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:00.463533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ddf26e86-2cfe-45df-bfcc-1db7fe9406ad tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:00.475327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ddf26e86-2cfe-45df-bfcc-1db7fe9406ad tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1318 microversion: 2.1 time: 0.477106 Apr 19 03:40:00.476222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 156/297] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:39:59 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:00.481537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-81f49e38-4f15-4c1a-aa2d-a841707abdad tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:00.482687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-81f49e38-4f15-4c1a-aa2d-a841707abdad tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:00.491797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81f49e38-4f15-4c1a-aa2d-a841707abdad tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:00.492300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81f49e38-4f15-4c1a-aa2d-a841707abdad tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:00.493791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81f49e38-4f15-4c1a-aa2d-a841707abdad tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:00.494284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81f49e38-4f15-4c1a-aa2d-a841707abdad tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:00.604120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-81f49e38-4f15-4c1a-aa2d-a841707abdad tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 38089 microversion: 2.1 time: 0.126026 Apr 19 03:40:00.604942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 157/298] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:40:00 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 38089 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:40:00.611712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-adf4bd6d-619f-4a3b-be66-e741901d7d65 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:00.612488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-adf4bd6d-619f-4a3b-be66-e741901d7d65 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:00.625276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adf4bd6d-619f-4a3b-be66-e741901d7d65 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:00.628950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adf4bd6d-619f-4a3b-be66-e741901d7d65 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:00.628950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adf4bd6d-619f-4a3b-be66-e741901d7d65 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:00.628950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adf4bd6d-619f-4a3b-be66-e741901d7d65 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:00.761097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-adf4bd6d-619f-4a3b-be66-e741901d7d65 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:00.770232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-adf4bd6d-619f-4a3b-be66-e741901d7d65 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1209 microversion: 2.1 time: 0.163768 Apr 19 03:40:00.770853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 158/299] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:00 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1209 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:00.801125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:40:00.801675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:40:00.802222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:40:00.802688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:40:00.803256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:40:00.813223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:00.813928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:00.814789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:00.815507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:00.833888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for project a1596875092a4918b57b2ca36f54fbd0. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:40:00.838428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for user 4c276e843fab41419f611a5dd2adc9e8 and project a1596875092a4918b57b2ca36f54fbd0. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:40:00.849963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:40:00.852753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:40:00.940890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-008c2b17-d774-4bc9-80f3-d9cc01ee4116 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.944999 Apr 19 03:40:00.941602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 142/300] 10.222.0.25 () {62 vars in 1178 bytes} [Mon Apr 19 03:39:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 19 03:40:00.952674 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-146260f7-6f73-43f9-a0a3-5bbd01d66785 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:00.953615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-146260f7-6f73-43f9-a0a3-5bbd01d66785 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:01.014146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-317c928e-f2d5-4e0f-913a-f4d900a7c132 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:01.014863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-317c928e-f2d5-4e0f-913a-f4d900a7c132 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:01.023167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-317c928e-f2d5-4e0f-913a-f4d900a7c132 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:01.023790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-317c928e-f2d5-4e0f-913a-f4d900a7c132 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:01.024634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-317c928e-f2d5-4e0f-913a-f4d900a7c132 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:01.025130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-317c928e-f2d5-4e0f-913a-f4d900a7c132 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:01.100199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-146260f7-6f73-43f9-a0a3-5bbd01d66785 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:01.111033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-146260f7-6f73-43f9-a0a3-5bbd01d66785 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:01.113222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-146260f7-6f73-43f9-a0a3-5bbd01d66785 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:01.114611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-146260f7-6f73-43f9-a0a3-5bbd01d66785 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1281 microversion: 2.20 time: 0.166407 Apr 19 03:40:01.115818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 159/301] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:00 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:01.405539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-317c928e-f2d5-4e0f-913a-f4d900a7c132 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:01.422724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-317c928e-f2d5-4e0f-913a-f4d900a7c132 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.412683 Apr 19 03:40:01.424383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 143/302] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:01 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:01.496150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-53a5a492-89b1-42ca-9017-2936a049418b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:01.497044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-53a5a492-89b1-42ca-9017-2936a049418b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:01.506169 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53a5a492-89b1-42ca-9017-2936a049418b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:01.507085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53a5a492-89b1-42ca-9017-2936a049418b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:01.508160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53a5a492-89b1-42ca-9017-2936a049418b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:01.508845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53a5a492-89b1-42ca-9017-2936a049418b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:01.617797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e5d3777e-c5dd-4bdd-9369-d5cea25ae6ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:01.619405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e5d3777e-c5dd-4bdd-9369-d5cea25ae6ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:01.639980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5d3777e-c5dd-4bdd-9369-d5cea25ae6ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:01.642532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5d3777e-c5dd-4bdd-9369-d5cea25ae6ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:01.643618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5d3777e-c5dd-4bdd-9369-d5cea25ae6ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:01.650714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5d3777e-c5dd-4bdd-9369-d5cea25ae6ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:01.866558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e5d3777e-c5dd-4bdd-9369-d5cea25ae6ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 38089 microversion: 2.1 time: 0.252683 Apr 19 03:40:01.868644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 144/303] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:40:01 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 38089 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:40:01.875604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7bf3d44f-95e3-4d76-849e-b38ff9ccc204 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:01.876700 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7bf3d44f-95e3-4d76-849e-b38ff9ccc204 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:01.887578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf3d44f-95e3-4d76-849e-b38ff9ccc204 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:01.888397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf3d44f-95e3-4d76-849e-b38ff9ccc204 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:01.890304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf3d44f-95e3-4d76-849e-b38ff9ccc204 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:01.891012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf3d44f-95e3-4d76-849e-b38ff9ccc204 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:01.898051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-53a5a492-89b1-42ca-9017-2936a049418b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:01.912654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-53a5a492-89b1-42ca-9017-2936a049418b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1507 microversion: 2.1 time: 0.419458 Apr 19 03:40:01.912654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 160/304] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:01 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:02.121764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7bf3d44f-95e3-4d76-849e-b38ff9ccc204 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:02.134008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7bf3d44f-95e3-4d76-849e-b38ff9ccc204 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1283 microversion: 2.1 time: 0.263521 Apr 19 03:40:02.134614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d1997392-48b8-4a9e-8dfd-abda73522b49 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:02.134747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 145/305] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:01 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1283 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:02.135543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d1997392-48b8-4a9e-8dfd-abda73522b49 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:02.163562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1997392-48b8-4a9e-8dfd-abda73522b49 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:02.172610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1997392-48b8-4a9e-8dfd-abda73522b49 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:02.175007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1997392-48b8-4a9e-8dfd-abda73522b49 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:02.177275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1997392-48b8-4a9e-8dfd-abda73522b49 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:02.378654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d1997392-48b8-4a9e-8dfd-abda73522b49 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:02.389354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d1997392-48b8-4a9e-8dfd-abda73522b49 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:02.391352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d1997392-48b8-4a9e-8dfd-abda73522b49 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:02.392771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d1997392-48b8-4a9e-8dfd-abda73522b49 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1277 microversion: 2.20 time: 0.262722 Apr 19 03:40:02.393874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 161/306] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:02 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1277 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:40:02.442095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-29108806-cbc6-411c-997f-8ec45a77542c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:02.442762 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-29108806-cbc6-411c-997f-8ec45a77542c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:02.456409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-29108806-cbc6-411c-997f-8ec45a77542c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:02.457022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-29108806-cbc6-411c-997f-8ec45a77542c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:02.458039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-29108806-cbc6-411c-997f-8ec45a77542c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:02.458888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-29108806-cbc6-411c-997f-8ec45a77542c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:02.861373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-29108806-cbc6-411c-997f-8ec45a77542c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:02.871861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-29108806-cbc6-411c-997f-8ec45a77542c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.434009 Apr 19 03:40:02.883062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 146/307] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:02 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:02.883300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a2c50a42-2b4e-47c3-866a-5c874365e38a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:02.883300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a2c50a42-2b4e-47c3-866a-5c874365e38a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:02.891294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2c50a42-2b4e-47c3-866a-5c874365e38a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:02.891922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2c50a42-2b4e-47c3-866a-5c874365e38a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:02.892863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2c50a42-2b4e-47c3-866a-5c874365e38a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:02.893432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2c50a42-2b4e-47c3-866a-5c874365e38a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:03.054022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a2c50a42-2b4e-47c3-866a-5c874365e38a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 38089 microversion: 2.1 time: 0.168965 Apr 19 03:40:03.054790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 162/308] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:40:02 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 38089 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 19 03:40:03.152638 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-126103bc-fb66-4141-a713-c5c7db1a4016 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:03.154162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-126103bc-fb66-4141-a713-c5c7db1a4016 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:03.162932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-126103bc-fb66-4141-a713-c5c7db1a4016 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:03.163475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-126103bc-fb66-4141-a713-c5c7db1a4016 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:03.164360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-126103bc-fb66-4141-a713-c5c7db1a4016 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:03.165040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-126103bc-fb66-4141-a713-c5c7db1a4016 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:03.413959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-38d46a33-cdf5-44ad-aac2-4bb33a22b0b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:03.414848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-38d46a33-cdf5-44ad-aac2-4bb33a22b0b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:03.435811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38d46a33-cdf5-44ad-aac2-4bb33a22b0b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:03.436600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38d46a33-cdf5-44ad-aac2-4bb33a22b0b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:03.438445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38d46a33-cdf5-44ad-aac2-4bb33a22b0b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:03.441207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38d46a33-cdf5-44ad-aac2-4bb33a22b0b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:03.584657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-38d46a33-cdf5-44ad-aac2-4bb33a22b0b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:03.596263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-38d46a33-cdf5-44ad-aac2-4bb33a22b0b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:03.598251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-38d46a33-cdf5-44ad-aac2-4bb33a22b0b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:03.599673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-38d46a33-cdf5-44ad-aac2-4bb33a22b0b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1351 microversion: 2.20 time: 0.190354 Apr 19 03:40:03.601342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 163/309] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:03 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1351 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:03.890554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e83d4b22-cc3c-4014-acc7-1786426bb3c8 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:03.891885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e83d4b22-cc3c-4014-acc7-1786426bb3c8 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:03.899820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e83d4b22-cc3c-4014-acc7-1786426bb3c8 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:03.900574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e83d4b22-cc3c-4014-acc7-1786426bb3c8 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:03.901601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e83d4b22-cc3c-4014-acc7-1786426bb3c8 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:03.902984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e83d4b22-cc3c-4014-acc7-1786426bb3c8 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:04.154967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-126103bc-fb66-4141-a713-c5c7db1a4016 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:04.166582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e83d4b22-cc3c-4014-acc7-1786426bb3c8 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:04.169000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-126103bc-fb66-4141-a713-c5c7db1a4016 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1313 microversion: 2.1 time: 1.020555 Apr 19 03:40:04.171027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 147/310] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:03 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1313 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:04.178788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-38b40fcd-4027-4c88-8d44-d1ef09ad51ff tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "348e6dfa-23b0-46a1-bec4-a55870fa340a"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:04.181774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-38b40fcd-4027-4c88-8d44-d1ef09ad51ff tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:04.186363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e83d4b22-cc3c-4014-acc7-1786426bb3c8 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.300225 Apr 19 03:40:04.186986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 164/311] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:03 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:04.203005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38b40fcd-4027-4c88-8d44-d1ef09ad51ff tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:04.203005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38b40fcd-4027-4c88-8d44-d1ef09ad51ff tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:04.203005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38b40fcd-4027-4c88-8d44-d1ef09ad51ff tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:04.203005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38b40fcd-4027-4c88-8d44-d1ef09ad51ff tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:04.205502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8840aa15-cc38-4be1-a060-00e43fc27bc0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:04.206752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8840aa15-cc38-4be1-a060-00e43fc27bc0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:04.215326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8840aa15-cc38-4be1-a060-00e43fc27bc0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:04.216106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8840aa15-cc38-4be1-a060-00e43fc27bc0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:04.218383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8840aa15-cc38-4be1-a060-00e43fc27bc0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:04.219046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8840aa15-cc38-4be1-a060-00e43fc27bc0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:04.347241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8840aa15-cc38-4be1-a060-00e43fc27bc0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 38089 microversion: 2.1 time: 0.155871 Apr 19 03:40:04.348006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 165/312] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:40:04 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 38089 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:40:04.628402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-29c4f44c-ae90-4fff-a9fd-de0aecaa775b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:04.629155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-29c4f44c-ae90-4fff-a9fd-de0aecaa775b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:04.640117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-29c4f44c-ae90-4fff-a9fd-de0aecaa775b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:04.640731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-29c4f44c-ae90-4fff-a9fd-de0aecaa775b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:04.641841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-29c4f44c-ae90-4fff-a9fd-de0aecaa775b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:04.642549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-29c4f44c-ae90-4fff-a9fd-de0aecaa775b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:04.815275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-29c4f44c-ae90-4fff-a9fd-de0aecaa775b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:04.827171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-29c4f44c-ae90-4fff-a9fd-de0aecaa775b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:04.831508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-29c4f44c-ae90-4fff-a9fd-de0aecaa775b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:04.832734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-29c4f44c-ae90-4fff-a9fd-de0aecaa775b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1339 microversion: 2.20 time: 0.210377 Apr 19 03:40:04.833353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 166/313] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:04 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:04.984820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-38b40fcd-4027-4c88-8d44-d1ef09ad51ff tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "POST /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811491 Apr 19 03:40:04.985498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 148/314] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:40:04 2021] POST /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:05.188203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ec780f99-65a4-49be-b106-f54ba566d264 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:05.188868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ec780f99-65a4-49be-b106-f54ba566d264 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:05.196753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ec780f99-65a4-49be-b106-f54ba566d264 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.197246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ec780f99-65a4-49be-b106-f54ba566d264 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:05.198073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ec780f99-65a4-49be-b106-f54ba566d264 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.198554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ec780f99-65a4-49be-b106-f54ba566d264 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:05.211192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c32ed5ba-49b7-47d5-9c40-c9f9f55aabaa tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:05.212221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c32ed5ba-49b7-47d5-9c40-c9f9f55aabaa tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:05.237378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c32ed5ba-49b7-47d5-9c40-c9f9f55aabaa tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.237892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c32ed5ba-49b7-47d5-9c40-c9f9f55aabaa tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:05.238951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c32ed5ba-49b7-47d5-9c40-c9f9f55aabaa tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.239469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c32ed5ba-49b7-47d5-9c40-c9f9f55aabaa tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:05.454145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ec780f99-65a4-49be-b106-f54ba566d264 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:05.463681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ec780f99-65a4-49be-b106-f54ba566d264 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1313 microversion: 2.1 time: 0.279559 Apr 19 03:40:05.464400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 167/315] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:05 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:05.471180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9b9d4db5-7dda-4daf-b62e-7fad4e4aa972 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:05.472727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9b9d4db5-7dda-4daf-b62e-7fad4e4aa972 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:05.481842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b9d4db5-7dda-4daf-b62e-7fad4e4aa972 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.482417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b9d4db5-7dda-4daf-b62e-7fad4e4aa972 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:05.483392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b9d4db5-7dda-4daf-b62e-7fad4e4aa972 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.483987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b9d4db5-7dda-4daf-b62e-7fad4e4aa972 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:05.594150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9b9d4db5-7dda-4daf-b62e-7fad4e4aa972 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 200 len: 38215 microversion: 2.1 time: 0.126963 Apr 19 03:40:05.600294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 168/316] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:40:05 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 38215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:40:05.606259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-af8e2339-4291-4e89-b3c3-9e816b00e939 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:05.607124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-af8e2339-4291-4e89-b3c3-9e816b00e939 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:05.616605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af8e2339-4291-4e89-b3c3-9e816b00e939 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.617482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af8e2339-4291-4e89-b3c3-9e816b00e939 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:05.618655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af8e2339-4291-4e89-b3c3-9e816b00e939 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.619346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af8e2339-4291-4e89-b3c3-9e816b00e939 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:05.717980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-af8e2339-4291-4e89-b3c3-9e816b00e939 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/ips" status: 200 len: 145 microversion: 2.1 time: 0.116018 Apr 19 03:40:05.720954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 169/317] 10.222.0.25 () {58 vars in 1238 bytes} [Mon Apr 19 03:40:05 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/ips => generated 145 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:05.738898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c32ed5ba-49b7-47d5-9c40-c9f9f55aabaa tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:05.744459 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-f9e2ba34-2baa-44d2-90d7-22e74d0c11fd req-e40dc6b6-de71-4cb4-808c-80a208ba60e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bfb24e-5dff-4ad3-955d-580cbe4449ed", "tag": "9a3486d3-4142-47f6-8698-a7b0978fa424"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:05.747198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:40:05.747198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:40:05.751909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c32ed5ba-49b7-47d5-9c40-c9f9f55aabaa tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.545140 Apr 19 03:40:05.764742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 149/318] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:05 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:05.766483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-f9e2ba34-2baa-44d2-90d7-22e74d0c11fd req-e40dc6b6-de71-4cb4-808c-80a208ba60e4 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.766983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-f9e2ba34-2baa-44d2-90d7-22e74d0c11fd req-e40dc6b6-de71-4cb4-808c-80a208ba60e4 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:05.788858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-f9e2ba34-2baa-44d2-90d7-22e74d0c11fd req-e40dc6b6-de71-4cb4-808c-80a208ba60e4 service nova] Creating event network-changed:9a3486d3-4142-47f6-8698-a7b0978fa424 for instance 80bfb24e-5dff-4ad3-955d-580cbe4449ed on hv-cinder-78605 Apr 19 03:40:05.795012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-f9e2ba34-2baa-44d2-90d7-22e74d0c11fd req-e40dc6b6-de71-4cb4-808c-80a208ba60e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074264 Apr 19 03:40:05.795935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 170/319] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:40:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:05.855850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9b553735-4397-417f-942f-7591fbb5efd2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:05.855850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9b553735-4397-417f-942f-7591fbb5efd2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:05.863564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b553735-4397-417f-942f-7591fbb5efd2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.863780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b553735-4397-417f-942f-7591fbb5efd2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:05.864552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b553735-4397-417f-942f-7591fbb5efd2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:05.865117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b553735-4397-417f-942f-7591fbb5efd2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:06.483923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d987e483-f27a-452a-a449-4b8df6ace41a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:06.484809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d987e483-f27a-452a-a449-4b8df6ace41a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:06.494062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d987e483-f27a-452a-a449-4b8df6ace41a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:06.494670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d987e483-f27a-452a-a449-4b8df6ace41a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:06.495638 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d987e483-f27a-452a-a449-4b8df6ace41a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:06.496206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d987e483-f27a-452a-a449-4b8df6ace41a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:06.619244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9b553735-4397-417f-942f-7591fbb5efd2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:06.632992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9b553735-4397-417f-942f-7591fbb5efd2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:06.635266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9b553735-4397-417f-942f-7591fbb5efd2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:06.637178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9b553735-4397-417f-942f-7591fbb5efd2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1407 microversion: 2.20 time: 0.787716 Apr 19 03:40:06.637958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 150/320] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:05 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1407 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:06.738223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d987e483-f27a-452a-a449-4b8df6ace41a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:06.747776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d987e483-f27a-452a-a449-4b8df6ace41a tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1313 microversion: 2.1 time: 0.269625 Apr 19 03:40:06.748753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 171/321] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:06 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:06.771698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-651b8ce2-fcc0-4ffd-87db-27b00bf61d41 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:06.772518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-651b8ce2-fcc0-4ffd-87db-27b00bf61d41 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:06.783240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-651b8ce2-fcc0-4ffd-87db-27b00bf61d41 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:06.783746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-651b8ce2-fcc0-4ffd-87db-27b00bf61d41 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:06.784671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-651b8ce2-fcc0-4ffd-87db-27b00bf61d41 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:06.785350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-651b8ce2-fcc0-4ffd-87db-27b00bf61d41 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:07.280349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-651b8ce2-fcc0-4ffd-87db-27b00bf61d41 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:07.294828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-651b8ce2-fcc0-4ffd-87db-27b00bf61d41 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.524322 Apr 19 03:40:07.295535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 151/322] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:06 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:07.657204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-817621b0-c543-484c-8464-d4d277aa3e36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:07.657897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-817621b0-c543-484c-8464-d4d277aa3e36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:07.668226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-817621b0-c543-484c-8464-d4d277aa3e36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:07.669088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-817621b0-c543-484c-8464-d4d277aa3e36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:07.670306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-817621b0-c543-484c-8464-d4d277aa3e36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:07.670985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-817621b0-c543-484c-8464-d4d277aa3e36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:07.765395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-94dac66e-1cc5-4527-9f0c-305fd25b2000 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:07.766295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-94dac66e-1cc5-4527-9f0c-305fd25b2000 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:07.775467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94dac66e-1cc5-4527-9f0c-305fd25b2000 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:07.776349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94dac66e-1cc5-4527-9f0c-305fd25b2000 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:07.777884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94dac66e-1cc5-4527-9f0c-305fd25b2000 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:07.778605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94dac66e-1cc5-4527-9f0c-305fd25b2000 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:07.996702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-817621b0-c543-484c-8464-d4d277aa3e36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:08.007722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-817621b0-c543-484c-8464-d4d277aa3e36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:08.009609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-817621b0-c543-484c-8464-d4d277aa3e36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:08.010850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-817621b0-c543-484c-8464-d4d277aa3e36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1407 microversion: 2.20 time: 0.358114 Apr 19 03:40:08.011698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 172/323] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:07 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:08.327004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d53c1526-aa4e-4257-a61b-0e1ce19421b5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:08.327004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d53c1526-aa4e-4257-a61b-0e1ce19421b5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:08.327004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d53c1526-aa4e-4257-a61b-0e1ce19421b5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:08.327004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d53c1526-aa4e-4257-a61b-0e1ce19421b5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:08.327426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d53c1526-aa4e-4257-a61b-0e1ce19421b5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:08.327426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d53c1526-aa4e-4257-a61b-0e1ce19421b5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:08.487874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-94dac66e-1cc5-4527-9f0c-305fd25b2000 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:08.509565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-94dac66e-1cc5-4527-9f0c-305fd25b2000 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1313 microversion: 2.1 time: 0.748427 Apr 19 03:40:08.510198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 152/324] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:07 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1313 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:08.516749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0f4674e7-ac9c-45cd-99b5-4ac2d83a7eab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39d3de1a-3f58-4817-9c4e-9045f18a5f6a"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:08.518674 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0f4674e7-ac9c-45cd-99b5-4ac2d83a7eab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:08.530637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f4674e7-ac9c-45cd-99b5-4ac2d83a7eab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:08.531429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f4674e7-ac9c-45cd-99b5-4ac2d83a7eab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:08.532443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f4674e7-ac9c-45cd-99b5-4ac2d83a7eab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:08.533670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f4674e7-ac9c-45cd-99b5-4ac2d83a7eab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:08.762328 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d53c1526-aa4e-4257-a61b-0e1ce19421b5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:08.785661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d53c1526-aa4e-4257-a61b-0e1ce19421b5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.477494 Apr 19 03:40:08.799452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 173/325] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:08 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:08.807034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-bd9cccab-bf12-4fd7-be00-864e94d23e6d req-40ac8729-73c8-461a-8856-e889c77efd69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29b14f0-f43c-434b-b583-cdf6b0e4b784", "tag": "8b1a69d0-ba1e-4994-b669-cc0e63d13b8b"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:08.811923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:40:08.811923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:40:08.824344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-bd9cccab-bf12-4fd7-be00-864e94d23e6d req-40ac8729-73c8-461a-8856-e889c77efd69 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:08.824344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-bd9cccab-bf12-4fd7-be00-864e94d23e6d req-40ac8729-73c8-461a-8856-e889c77efd69 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:08.843592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-bd9cccab-bf12-4fd7-be00-864e94d23e6d req-40ac8729-73c8-461a-8856-e889c77efd69 service nova] Creating event network-changed:8b1a69d0-ba1e-4994-b669-cc0e63d13b8b for instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 on hv-cinder-78605 Apr 19 03:40:08.849406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-bd9cccab-bf12-4fd7-be00-864e94d23e6d req-40ac8729-73c8-461a-8856-e889c77efd69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047795 Apr 19 03:40:08.850071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 174/326] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:40:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:09.031504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-07db7872-fe60-4ce6-8c38-2b456fb15094 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:09.032631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-07db7872-fe60-4ce6-8c38-2b456fb15094 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:09.041262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-07db7872-fe60-4ce6-8c38-2b456fb15094 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:09.041772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-07db7872-fe60-4ce6-8c38-2b456fb15094 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:09.042663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-07db7872-fe60-4ce6-8c38-2b456fb15094 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:09.043180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-07db7872-fe60-4ce6-8c38-2b456fb15094 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:09.298002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-07db7872-fe60-4ce6-8c38-2b456fb15094 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:09.335464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-07db7872-fe60-4ce6-8c38-2b456fb15094 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:09.340592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-07db7872-fe60-4ce6-8c38-2b456fb15094 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:09.341710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0f4674e7-ac9c-45cd-99b5-4ac2d83a7eab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807876 Apr 19 03:40:09.342669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-07db7872-fe60-4ce6-8c38-2b456fb15094 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1407 microversion: 2.20 time: 0.316129 Apr 19 03:40:09.343470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 175/327] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:09 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:40:09.344353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 153/328] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:40:08 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/os-volume_attachments => generated 194 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:09.528744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f85edbfc-8694-478f-9fcc-c1508bd474a7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:09.529643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f85edbfc-8694-478f-9fcc-c1508bd474a7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:09.546413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f85edbfc-8694-478f-9fcc-c1508bd474a7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:09.548259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f85edbfc-8694-478f-9fcc-c1508bd474a7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:09.557068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f85edbfc-8694-478f-9fcc-c1508bd474a7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:09.557776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f85edbfc-8694-478f-9fcc-c1508bd474a7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:09.806060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fc5db2a4-c2df-43f2-831d-826e8dfd0192 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:09.806957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fc5db2a4-c2df-43f2-831d-826e8dfd0192 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:09.835268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc5db2a4-c2df-43f2-831d-826e8dfd0192 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:09.840302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc5db2a4-c2df-43f2-831d-826e8dfd0192 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:09.842241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc5db2a4-c2df-43f2-831d-826e8dfd0192 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:09.844766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc5db2a4-c2df-43f2-831d-826e8dfd0192 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:09.971448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f85edbfc-8694-478f-9fcc-c1508bd474a7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:09.981425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f85edbfc-8694-478f-9fcc-c1508bd474a7 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1313 microversion: 2.1 time: 0.457419 Apr 19 03:40:09.982093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 176/329] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:09 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:10.362207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4cf866b9-0762-4c27-80fc-3b77c01fa37c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:10.362880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4cf866b9-0762-4c27-80fc-3b77c01fa37c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:10.371287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4cf866b9-0762-4c27-80fc-3b77c01fa37c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:10.372556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4cf866b9-0762-4c27-80fc-3b77c01fa37c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:10.373412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4cf866b9-0762-4c27-80fc-3b77c01fa37c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:10.373910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4cf866b9-0762-4c27-80fc-3b77c01fa37c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:10.428719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fc5db2a4-c2df-43f2-831d-826e8dfd0192 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:10.441363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fc5db2a4-c2df-43f2-831d-826e8dfd0192 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1501 microversion: 2.1 time: 0.640101 Apr 19 03:40:10.454630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 154/330] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:09 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1501 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:10.461211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d036436b-3e3a-4eb2-acba-1981be0e7c26 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9c77664-78c3-4759-abfd-89d48cd874a9"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:10.464214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d036436b-3e3a-4eb2-acba-1981be0e7c26 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:10.473413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d036436b-3e3a-4eb2-acba-1981be0e7c26 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:10.476471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d036436b-3e3a-4eb2-acba-1981be0e7c26 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:10.476471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d036436b-3e3a-4eb2-acba-1981be0e7c26 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:10.476471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d036436b-3e3a-4eb2-acba-1981be0e7c26 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:10.574483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-d036436b-3e3a-4eb2-acba-1981be0e7c26 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] HTTP exception thrown: Cannot 'attach_volume' instance 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 while it is in vm_state rescued Apr 19 03:40:10.575356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d036436b-3e3a-4eb2-acba-1981be0e7c26 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Returning 409 to user: Cannot 'attach_volume' instance 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 while it is in vm_state rescued {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:40:10.576507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d036436b-3e3a-4eb2-acba-1981be0e7c26 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.120294 Apr 19 03:40:10.579609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 155/331] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:40:10 2021] POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/os-volume_attachments => generated 152 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 19 03:40:10.595586 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ad6af848-bb56-4dce-9bfc-0ecf51a82885 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:10.596292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ad6af848-bb56-4dce-9bfc-0ecf51a82885 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:10.609108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ad6af848-bb56-4dce-9bfc-0ecf51a82885 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:10.609740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ad6af848-bb56-4dce-9bfc-0ecf51a82885 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:10.611285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ad6af848-bb56-4dce-9bfc-0ecf51a82885 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:10.611868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ad6af848-bb56-4dce-9bfc-0ecf51a82885 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:10.675543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4cf866b9-0762-4c27-80fc-3b77c01fa37c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:10.687323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4cf866b9-0762-4c27-80fc-3b77c01fa37c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:10.689765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4cf866b9-0762-4c27-80fc-3b77c01fa37c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:10.691061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4cf866b9-0762-4c27-80fc-3b77c01fa37c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1407 microversion: 2.20 time: 0.333258 Apr 19 03:40:10.692114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 177/332] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:10 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:10.836615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ad6af848-bb56-4dce-9bfc-0ecf51a82885 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/action" status: 202 len: 0 microversion: 2.1 time: 0.254361 Apr 19 03:40:10.837435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 156/333] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:40:10 2021] POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:40:10.847062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-10dea7d1-dbf6-4705-ad5c-62a9496082ad tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:10.848185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-10dea7d1-dbf6-4705-ad5c-62a9496082ad tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:10.858599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10dea7d1-dbf6-4705-ad5c-62a9496082ad tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:10.859442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10dea7d1-dbf6-4705-ad5c-62a9496082ad tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:10.860308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10dea7d1-dbf6-4705-ad5c-62a9496082ad tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:10.860991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10dea7d1-dbf6-4705-ad5c-62a9496082ad tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:11.000516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0d987114-5fb5-4d26-9121-22f77ef3f089 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:11.001298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0d987114-5fb5-4d26-9121-22f77ef3f089 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:11.009645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d987114-5fb5-4d26-9121-22f77ef3f089 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:11.010154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d987114-5fb5-4d26-9121-22f77ef3f089 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:11.010988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d987114-5fb5-4d26-9121-22f77ef3f089 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:11.011505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d987114-5fb5-4d26-9121-22f77ef3f089 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:11.102490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-10dea7d1-dbf6-4705-ad5c-62a9496082ad tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:11.113824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-10dea7d1-dbf6-4705-ad5c-62a9496082ad tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1509 microversion: 2.1 time: 0.270833 Apr 19 03:40:11.115198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 178/334] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:10 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:11.712619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-677da408-bb72-411a-a060-daa5faf3bbe5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:11.713554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-677da408-bb72-411a-a060-daa5faf3bbe5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:11.733080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-677da408-bb72-411a-a060-daa5faf3bbe5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:11.733999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-677da408-bb72-411a-a060-daa5faf3bbe5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:11.735174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-677da408-bb72-411a-a060-daa5faf3bbe5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:11.736930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0d987114-5fb5-4d26-9121-22f77ef3f089 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:11.737582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-677da408-bb72-411a-a060-daa5faf3bbe5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:11.755804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0d987114-5fb5-4d26-9121-22f77ef3f089 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1313 microversion: 2.1 time: 0.759869 Apr 19 03:40:11.756702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 157/335] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:10 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:12.040752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-677da408-bb72-411a-a060-daa5faf3bbe5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:12.052554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-677da408-bb72-411a-a060-daa5faf3bbe5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:12.054227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-677da408-bb72-411a-a060-daa5faf3bbe5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:12.055454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-677da408-bb72-411a-a060-daa5faf3bbe5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1407 microversion: 2.20 time: 0.349226 Apr 19 03:40:12.059200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 179/336] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:11 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:12.132863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-017899f3-05d6-43e3-8c08-aa33b1971324 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:12.139786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-017899f3-05d6-43e3-8c08-aa33b1971324 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:12.148989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-017899f3-05d6-43e3-8c08-aa33b1971324 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:12.149644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-017899f3-05d6-43e3-8c08-aa33b1971324 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:12.150812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-017899f3-05d6-43e3-8c08-aa33b1971324 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:12.151368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-017899f3-05d6-43e3-8c08-aa33b1971324 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:12.678460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-017899f3-05d6-43e3-8c08-aa33b1971324 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:12.696125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-017899f3-05d6-43e3-8c08-aa33b1971324 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1509 microversion: 2.1 time: 0.567198 Apr 19 03:40:12.706855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 158/337] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:12 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:12.731125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-3fbca486-56f0-4670-aefd-597854bd8558 req-c3f43f59-8c79-417a-a797-042305481189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bfb24e-5dff-4ad3-955d-580cbe4449ed", "name": "network-vif-plugged", "status": "completed", "tag": "9a3486d3-4142-47f6-8698-a7b0978fa424"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:12.733453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:40:12.733453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:40:12.743516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-3fbca486-56f0-4670-aefd-597854bd8558 req-c3f43f59-8c79-417a-a797-042305481189 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:12.744210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-3fbca486-56f0-4670-aefd-597854bd8558 req-c3f43f59-8c79-417a-a797-042305481189 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:12.764579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-3fbca486-56f0-4670-aefd-597854bd8558 req-c3f43f59-8c79-417a-a797-042305481189 service nova] Creating event network-vif-plugged:9a3486d3-4142-47f6-8698-a7b0978fa424 for instance 80bfb24e-5dff-4ad3-955d-580cbe4449ed on hv-cinder-78605 Apr 19 03:40:12.778675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ef72d41e-5b44-4cf0-8703-721d487acac0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:12.779598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ef72d41e-5b44-4cf0-8703-721d487acac0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:12.783917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-3fbca486-56f0-4670-aefd-597854bd8558 req-c3f43f59-8c79-417a-a797-042305481189 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053633 Apr 19 03:40:12.786682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 180/338] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:40:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:12.790553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef72d41e-5b44-4cf0-8703-721d487acac0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:12.791282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef72d41e-5b44-4cf0-8703-721d487acac0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:12.792824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef72d41e-5b44-4cf0-8703-721d487acac0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:12.793481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef72d41e-5b44-4cf0-8703-721d487acac0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:13.054142 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ef72d41e-5b44-4cf0-8703-721d487acac0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:13.065340 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ef72d41e-5b44-4cf0-8703-721d487acac0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1313 microversion: 2.1 time: 0.290734 Apr 19 03:40:13.067013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 159/339] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:12 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:13.083744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6757406a-0fc8-4a78-8414-167a0bb7e87e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:13.085113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6757406a-0fc8-4a78-8414-167a0bb7e87e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:13.110545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6757406a-0fc8-4a78-8414-167a0bb7e87e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:13.112015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6757406a-0fc8-4a78-8414-167a0bb7e87e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:13.113316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6757406a-0fc8-4a78-8414-167a0bb7e87e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:13.114020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6757406a-0fc8-4a78-8414-167a0bb7e87e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:13.380273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b963733f-c54e-4a7a-9bcf-482aa48c74b2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "348e6dfa-23b0-46a1-bec4-a55870fa340a"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:13.381114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6757406a-0fc8-4a78-8414-167a0bb7e87e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:13.381485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b963733f-c54e-4a7a-9bcf-482aa48c74b2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:13.390719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b963733f-c54e-4a7a-9bcf-482aa48c74b2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:13.391315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6757406a-0fc8-4a78-8414-167a0bb7e87e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:13.391764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b963733f-c54e-4a7a-9bcf-482aa48c74b2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:13.392820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b963733f-c54e-4a7a-9bcf-482aa48c74b2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:13.392960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6757406a-0fc8-4a78-8414-167a0bb7e87e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:13.393610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b963733f-c54e-4a7a-9bcf-482aa48c74b2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:13.394499 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6757406a-0fc8-4a78-8414-167a0bb7e87e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1407 microversion: 2.20 time: 0.316304 Apr 19 03:40:13.395458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 181/340] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:13 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:13.612109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-b963733f-c54e-4a7a-9bcf-482aa48c74b2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] HTTP exception thrown: Invalid volume: volume 348e6dfa-23b0-46a1-bec4-a55870fa340a is already attached to instances: 22be386b-f516-47e4-8c1a-4ceadfb6af9b Apr 19 03:40:13.613040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b963733f-c54e-4a7a-9bcf-482aa48c74b2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Returning 400 to user: Invalid volume: volume 348e6dfa-23b0-46a1-bec4-a55870fa340a is already attached to instances: 22be386b-f516-47e4-8c1a-4ceadfb6af9b {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:40:13.614071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b963733f-c54e-4a7a-9bcf-482aa48c74b2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "POST /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.238471 Apr 19 03:40:13.614697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 160/341] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:40:13 2021] POST /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b/os-volume_attachments => generated 174 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 03:40:13.715309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0e65396b-e4c2-43db-a091-9317f9be0a0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:13.715990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0e65396b-e4c2-43db-a091-9317f9be0a0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:13.725236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e65396b-e4c2-43db-a091-9317f9be0a0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:13.725991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e65396b-e4c2-43db-a091-9317f9be0a0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:13.727049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e65396b-e4c2-43db-a091-9317f9be0a0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:13.727778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e65396b-e4c2-43db-a091-9317f9be0a0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:13.730581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cecdefb6-0247-4a5e-95f9-41c93af2215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:13.731131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cecdefb6-0247-4a5e-95f9-41c93af2215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:13.739278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cecdefb6-0247-4a5e-95f9-41c93af2215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:13.739985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cecdefb6-0247-4a5e-95f9-41c93af2215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:13.740833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cecdefb6-0247-4a5e-95f9-41c93af2215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:13.741335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cecdefb6-0247-4a5e-95f9-41c93af2215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:13.931596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-cecdefb6-0247-4a5e-95f9-41c93af2215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lazy-loading 'services' on Instance uuid 22be386b-f516-47e4-8c1a-4ceadfb6af9b {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:40:14.040450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0e65396b-e4c2-43db-a091-9317f9be0a0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:14.055360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0e65396b-e4c2-43db-a091-9317f9be0a0c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1509 microversion: 2.1 time: 0.343928 Apr 19 03:40:14.055360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 182/342] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:13 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1509 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:14.087022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-de195565-6f2c-41e6-af75-6143ad54dd86 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:14.087022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-de195565-6f2c-41e6-af75-6143ad54dd86 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:14.094888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de195565-6f2c-41e6-af75-6143ad54dd86 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:14.095449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de195565-6f2c-41e6-af75-6143ad54dd86 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:14.096286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de195565-6f2c-41e6-af75-6143ad54dd86 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:14.096774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de195565-6f2c-41e6-af75-6143ad54dd86 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:14.182537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cecdefb6-0247-4a5e-95f9-41c93af2215e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b/os-volume_attachments/348e6dfa-23b0-46a1-bec4-a55870fa340a" status: 202 len: 0 microversion: 2.1 time: 0.455029 Apr 19 03:40:14.184756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 161/343] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:40:13 2021] DELETE /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b/os-volume_attachments/348e6dfa-23b0-46a1-bec4-a55870fa340a => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:40:14.338379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-de195565-6f2c-41e6-af75-6143ad54dd86 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:14.349764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-de195565-6f2c-41e6-af75-6143ad54dd86 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1313 microversion: 2.1 time: 0.268112 Apr 19 03:40:14.351049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 183/344] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:14 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:14.419272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a894e1b6-62ec-49ac-b4b7-12164058280d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:14.419272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a894e1b6-62ec-49ac-b4b7-12164058280d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:14.424526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a894e1b6-62ec-49ac-b4b7-12164058280d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:14.425031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a894e1b6-62ec-49ac-b4b7-12164058280d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:14.425872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a894e1b6-62ec-49ac-b4b7-12164058280d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:14.426360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a894e1b6-62ec-49ac-b4b7-12164058280d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:14.677240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a894e1b6-62ec-49ac-b4b7-12164058280d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:14.688055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a894e1b6-62ec-49ac-b4b7-12164058280d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:14.689792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a894e1b6-62ec-49ac-b4b7-12164058280d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:14.690967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a894e1b6-62ec-49ac-b4b7-12164058280d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1407 microversion: 2.20 time: 0.280389 Apr 19 03:40:14.691616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 162/345] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:14 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:15.072667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cbe86b04-763a-4601-94da-8fad18ad1d77 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:15.073380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cbe86b04-763a-4601-94da-8fad18ad1d77 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:15.082000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cbe86b04-763a-4601-94da-8fad18ad1d77 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:15.083830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cbe86b04-763a-4601-94da-8fad18ad1d77 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:15.084479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cbe86b04-763a-4601-94da-8fad18ad1d77 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:15.084982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cbe86b04-763a-4601-94da-8fad18ad1d77 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:15.368183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e6621655-465e-43e7-aeb2-6c9cc72370f2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:15.368848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e6621655-465e-43e7-aeb2-6c9cc72370f2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:15.377597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e6621655-465e-43e7-aeb2-6c9cc72370f2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:15.378092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e6621655-465e-43e7-aeb2-6c9cc72370f2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:15.378965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e6621655-465e-43e7-aeb2-6c9cc72370f2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:15.379473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e6621655-465e-43e7-aeb2-6c9cc72370f2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:15.618735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e6621655-465e-43e7-aeb2-6c9cc72370f2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:15.628858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e6621655-465e-43e7-aeb2-6c9cc72370f2 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1497 microversion: 2.1 time: 0.264569 Apr 19 03:40:15.629467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 163/346] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:15 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1497 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:15.671879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cbe86b04-763a-4601-94da-8fad18ad1d77 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:15.681078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cbe86b04-763a-4601-94da-8fad18ad1d77 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1509 microversion: 2.1 time: 0.612451 Apr 19 03:40:15.681685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 184/347] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:15 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1509 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:15.710286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-01856f5a-3ac6-49cb-a40f-bea41670041a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:15.710950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-01856f5a-3ac6-49cb-a40f-bea41670041a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:15.719721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01856f5a-3ac6-49cb-a40f-bea41670041a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:15.720227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01856f5a-3ac6-49cb-a40f-bea41670041a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:15.721053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01856f5a-3ac6-49cb-a40f-bea41670041a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:15.721537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01856f5a-3ac6-49cb-a40f-bea41670041a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:15.937654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-01856f5a-3ac6-49cb-a40f-bea41670041a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:15.947276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-01856f5a-3ac6-49cb-a40f-bea41670041a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:15.949072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-01856f5a-3ac6-49cb-a40f-bea41670041a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:15.950239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-01856f5a-3ac6-49cb-a40f-bea41670041a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1407 microversion: 2.20 time: 0.244092 Apr 19 03:40:15.950848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 164/348] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:15 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:16.450041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-5a0635c2-d896-4cf3-a553-a7bac6aa4eb1 req-91d7cd98-7881-4744-8d1e-c4542dc600d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29b14f0-f43c-434b-b583-cdf6b0e4b784", "name": "network-vif-plugged", "status": "completed", "tag": "8b1a69d0-ba1e-4994-b669-cc0e63d13b8b"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:16.456597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:40:16.456597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:40:16.466861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-5a0635c2-d896-4cf3-a553-a7bac6aa4eb1 req-91d7cd98-7881-4744-8d1e-c4542dc600d8 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:16.467562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-5a0635c2-d896-4cf3-a553-a7bac6aa4eb1 req-91d7cd98-7881-4744-8d1e-c4542dc600d8 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:16.487448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-5a0635c2-d896-4cf3-a553-a7bac6aa4eb1 req-91d7cd98-7881-4744-8d1e-c4542dc600d8 service nova] Creating event network-vif-plugged:8b1a69d0-ba1e-4994-b669-cc0e63d13b8b for instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 on hv-cinder-78605 Apr 19 03:40:16.493317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-5a0635c2-d896-4cf3-a553-a7bac6aa4eb1 req-91d7cd98-7881-4744-8d1e-c4542dc600d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049558 Apr 19 03:40:16.494395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 185/349] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:40:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:16.700395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5ab31420-08fe-4701-a00f-2103add2ebca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:16.701390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5ab31420-08fe-4701-a00f-2103add2ebca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:16.709808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ab31420-08fe-4701-a00f-2103add2ebca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:16.710316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ab31420-08fe-4701-a00f-2103add2ebca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:16.711177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ab31420-08fe-4701-a00f-2103add2ebca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:16.715336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ab31420-08fe-4701-a00f-2103add2ebca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:16.728628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-efec55c7-1b49-43b8-adec-6c9f13c806ba tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:16.729564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-efec55c7-1b49-43b8-adec-6c9f13c806ba tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:16.738490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efec55c7-1b49-43b8-adec-6c9f13c806ba tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:16.738994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efec55c7-1b49-43b8-adec-6c9f13c806ba tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:16.739890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efec55c7-1b49-43b8-adec-6c9f13c806ba tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:16.740392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efec55c7-1b49-43b8-adec-6c9f13c806ba tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:16.811110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-efec55c7-1b49-43b8-adec-6c9f13c806ba tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Going to try to terminate instance {{(pid=100591) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:40:17.026628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5ab31420-08fe-4701-a00f-2103add2ebca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:17.031125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-efec55c7-1b49-43b8-adec-6c9f13c806ba tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 204 len: 0 microversion: 2.1 time: 0.306533 Apr 19 03:40:17.031802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 186/350] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:40:16 2021] DELETE /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:40:17.038083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9072eaf3-f86a-41b2-8f99-2edc691fa188 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:17.038865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9072eaf3-f86a-41b2-8f99-2edc691fa188 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:17.040806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5ab31420-08fe-4701-a00f-2103add2ebca tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1515 microversion: 2.1 time: 0.341623 Apr 19 03:40:17.041913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 165/351] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:16 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1515 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:17.047284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bc07f6d2-fa09-47bb-bf6e-158e97bf4ef3 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:17.047960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bc07f6d2-fa09-47bb-bf6e-158e97bf4ef3 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:17.055621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9072eaf3-f86a-41b2-8f99-2edc691fa188 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:17.056105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc07f6d2-fa09-47bb-bf6e-158e97bf4ef3 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:17.056797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9072eaf3-f86a-41b2-8f99-2edc691fa188 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:17.056939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc07f6d2-fa09-47bb-bf6e-158e97bf4ef3 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:17.058421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc07f6d2-fa09-47bb-bf6e-158e97bf4ef3 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:17.058550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9072eaf3-f86a-41b2-8f99-2edc691fa188 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:17.059223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9072eaf3-f86a-41b2-8f99-2edc691fa188 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:17.059398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc07f6d2-fa09-47bb-bf6e-158e97bf4ef3 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:17.311386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9072eaf3-f86a-41b2-8f99-2edc691fa188 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:17.316635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9072eaf3-f86a-41b2-8f99-2edc691fa188 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:17.318529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9072eaf3-f86a-41b2-8f99-2edc691fa188 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:17.319745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9072eaf3-f86a-41b2-8f99-2edc691fa188 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1407 microversion: 2.20 time: 0.286593 Apr 19 03:40:17.320360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 187/352] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:17 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:17.434351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bc07f6d2-fa09-47bb-bf6e-158e97bf4ef3 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:17.445036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bc07f6d2-fa09-47bb-bf6e-158e97bf4ef3 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1503 microversion: 2.1 time: 0.401731 Apr 19 03:40:17.446057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 166/353] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:17 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:18.339124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4aca0282-3164-44c2-82a2-1c093f6929f0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:18.340509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4aca0282-3164-44c2-82a2-1c093f6929f0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:18.349232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4aca0282-3164-44c2-82a2-1c093f6929f0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:18.349851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4aca0282-3164-44c2-82a2-1c093f6929f0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:18.350780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4aca0282-3164-44c2-82a2-1c093f6929f0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:18.351530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4aca0282-3164-44c2-82a2-1c093f6929f0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:18.463934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1be38dc6-6fae-4653-9684-0abac53f19cf tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:18.464611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1be38dc6-6fae-4653-9684-0abac53f19cf tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:18.480122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1be38dc6-6fae-4653-9684-0abac53f19cf tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:18.480859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1be38dc6-6fae-4653-9684-0abac53f19cf tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:18.481906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1be38dc6-6fae-4653-9684-0abac53f19cf tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:18.482585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1be38dc6-6fae-4653-9684-0abac53f19cf tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:18.616488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4aca0282-3164-44c2-82a2-1c093f6929f0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:18.650898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4aca0282-3164-44c2-82a2-1c093f6929f0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:18.657338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4aca0282-3164-44c2-82a2-1c093f6929f0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:18.658531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4aca0282-3164-44c2-82a2-1c093f6929f0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1407 microversion: 2.20 time: 0.323541 Apr 19 03:40:18.659517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 188/354] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:18 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:18.749844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-57799749-12b0-44f8-a256-104517ae4ccf tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:18.750519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-57799749-12b0-44f8-a256-104517ae4ccf tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:18.758651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57799749-12b0-44f8-a256-104517ae4ccf tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:18.759370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57799749-12b0-44f8-a256-104517ae4ccf tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:18.760005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57799749-12b0-44f8-a256-104517ae4ccf tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:18.760474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57799749-12b0-44f8-a256-104517ae4ccf tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:18.997147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-57799749-12b0-44f8-a256-104517ae4ccf tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:19.006258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-57799749-12b0-44f8-a256-104517ae4ccf tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1515 microversion: 2.1 time: 0.261045 Apr 19 03:40:19.006852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 189/355] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:18 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:19.024162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7178e8a5-c199-4bca-af5e-cc51f48eb9dd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f890e8bd-42c0-4fdd-9abb-393eee851536"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:19.025359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7178e8a5-c199-4bca-af5e-cc51f48eb9dd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:19.033170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7178e8a5-c199-4bca-af5e-cc51f48eb9dd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:19.033627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7178e8a5-c199-4bca-af5e-cc51f48eb9dd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:19.034462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7178e8a5-c199-4bca-af5e-cc51f48eb9dd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:19.034931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7178e8a5-c199-4bca-af5e-cc51f48eb9dd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:19.087422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1be38dc6-6fae-4653-9684-0abac53f19cf tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:19.098426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1be38dc6-6fae-4653-9684-0abac53f19cf tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1503 microversion: 2.1 time: 0.638467 Apr 19 03:40:19.099389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 167/356] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:18 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1503 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:19.626341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7178e8a5-c199-4bca-af5e-cc51f48eb9dd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.605666 Apr 19 03:40:19.632984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 190/357] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:40:19 2021] POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/os-volume_attachments => generated 194 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:19.678408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-65b8e555-b2d2-475b-8b17-1f8002d4e63e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:19.679431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-65b8e555-b2d2-475b-8b17-1f8002d4e63e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:19.688102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65b8e555-b2d2-475b-8b17-1f8002d4e63e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:19.688904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65b8e555-b2d2-475b-8b17-1f8002d4e63e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:19.690671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65b8e555-b2d2-475b-8b17-1f8002d4e63e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:19.691380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65b8e555-b2d2-475b-8b17-1f8002d4e63e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:20.118506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-331c3d60-c883-4c94-8d82-53293cd931b0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:20.119263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-331c3d60-c883-4c94-8d82-53293cd931b0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:20.129063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-331c3d60-c883-4c94-8d82-53293cd931b0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:20.129574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-331c3d60-c883-4c94-8d82-53293cd931b0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:20.130432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-331c3d60-c883-4c94-8d82-53293cd931b0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:20.130980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-331c3d60-c883-4c94-8d82-53293cd931b0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:20.365580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-331c3d60-c883-4c94-8d82-53293cd931b0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:20.375643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-331c3d60-c883-4c94-8d82-53293cd931b0 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1503 microversion: 2.1 time: 0.261887 Apr 19 03:40:20.376280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 191/358] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:20 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:20.600862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-65b8e555-b2d2-475b-8b17-1f8002d4e63e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:20.613380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-65b8e555-b2d2-475b-8b17-1f8002d4e63e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:20.615365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-65b8e555-b2d2-475b-8b17-1f8002d4e63e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:20.616601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-65b8e555-b2d2-475b-8b17-1f8002d4e63e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1599 microversion: 2.20 time: 0.942509 Apr 19 03:40:20.617218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 168/359] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:40:19 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1599 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:20.636803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d357e3bb-b7bf-4ada-890a-8798c08cbe5d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:20.637377 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d357e3bb-b7bf-4ada-890a-8798c08cbe5d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:20.645236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d357e3bb-b7bf-4ada-890a-8798c08cbe5d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:20.645752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d357e3bb-b7bf-4ada-890a-8798c08cbe5d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:20.646597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d357e3bb-b7bf-4ada-890a-8798c08cbe5d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:20.647088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d357e3bb-b7bf-4ada-890a-8798c08cbe5d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:20.823784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d357e3bb-b7bf-4ada-890a-8798c08cbe5d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.191191 Apr 19 03:40:20.824404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 192/360] 10.222.0.25 () {60 vars in 1306 bytes} [Mon Apr 19 03:40:20 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:40:21.345308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-732aa1a6-1032-45f4-8350-312b9d3d8fb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:21.357909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1991300143", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "networks": [{"uuid": "c6488502-d478-4c15-aad9-cec2dbbd6c1f"}]}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:21.373522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-732aa1a6-1032-45f4-8350-312b9d3d8fb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:21.376645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-732aa1a6-1032-45f4-8350-312b9d3d8fb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:21.481806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] validate_networks() for [('c6488502-d478-4c15-aad9-cec2dbbd6c1f', None, None, None)] {{(pid=100591) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:40:21.486952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-732aa1a6-1032-45f4-8350-312b9d3d8fb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Going to try to stop instance {{(pid=100590) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 19 03:40:21.727578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-732aa1a6-1032-45f4-8350-312b9d3d8fb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 202 len: 0 microversion: 2.1 time: 0.386414 Apr 19 03:40:21.731632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 169/361] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:40:21 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:40:21.736139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-003a0df9-a84d-445d-ae9e-b1b24cca6c1d req-a1b46943-d0a8-4f77-a7be-5d091dfa891c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bfb24e-5dff-4ad3-955d-580cbe4449ed", "name": "network-vif-deleted", "tag": "9a3486d3-4142-47f6-8698-a7b0978fa424"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:21.738127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:40:21.738127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:40:21.748192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-003a0df9-a84d-445d-ae9e-b1b24cca6c1d req-a1b46943-d0a8-4f77-a7be-5d091dfa891c service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:21.748679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-003a0df9-a84d-445d-ae9e-b1b24cca6c1d req-a1b46943-d0a8-4f77-a7be-5d091dfa891c service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:21.771425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-003a0df9-a84d-445d-ae9e-b1b24cca6c1d req-a1b46943-d0a8-4f77-a7be-5d091dfa891c service nova] Creating event network-vif-deleted:9a3486d3-4142-47f6-8698-a7b0978fa424 for instance 80bfb24e-5dff-4ad3-955d-580cbe4449ed on hv-cinder-78605 Apr 19 03:40:21.777077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-003a0df9-a84d-445d-ae9e-b1b24cca6c1d req-a1b46943-d0a8-4f77-a7be-5d091dfa891c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046576 Apr 19 03:40:21.777889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 170/362] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:40:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:21.783585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:21.784340 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:21.800666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:21.801176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:21.804722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:21.804722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:21.889122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:21.889632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:21.890124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lazy-loading 'fault' on Instance uuid 80bfb24e-5dff-4ad3-955d-580cbe4449ed {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:40:22.065545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d286fb2597d4c10ab08f6317b3a9046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d298f017a843b39a22bd94f3bcfdd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:22.078300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8e6f0d1a-1b83-409f-a5af-bbe258c0843d tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 200 len: 1303 microversion: 2.1 time: 0.298997 Apr 19 03:40:22.091950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 171/363] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:21 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 1303 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:22.097105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-83b00028-8d9b-4126-8c4e-671781e370b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:22.097786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-83b00028-8d9b-4126-8c4e-671781e370b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:22.106560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83b00028-8d9b-4126-8c4e-671781e370b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:22.107351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83b00028-8d9b-4126-8c4e-671781e370b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:22.108229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83b00028-8d9b-4126-8c4e-671781e370b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:22.108906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83b00028-8d9b-4126-8c4e-671781e370b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:22.409394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-83b00028-8d9b-4126-8c4e-671781e370b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:22.420788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-83b00028-8d9b-4126-8c4e-671781e370b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.327658 Apr 19 03:40:22.421582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 172/364] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:22 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:22.858163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Flavor limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:40:22.859260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Image limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:40:22.860009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Flavor pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:40:22.860551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Image pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:40:22.861349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:40:22.870919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:22.871550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:22.872513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:22.873086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:22.892207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Getting quotas for project 3a4502ef85b348a384aa26343b925024. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:40:22.896789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Getting quotas for user 7230efa31a8f47ca95af1f576f73cd90 and project 3a4502ef85b348a384aa26343b925024. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:40:22.908791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Going to run 1 instances... {{(pid=100591) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:40:22.911609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:40:23.098088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1298251c-fcaa-4638-b2eb-0962ba446e43 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:23.098766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1298251c-fcaa-4638-b2eb-0962ba446e43 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] [instance: 80bfb24e-5dff-4ad3-955d-580cbe4449ed] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:23.119042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1298251c-fcaa-4638-b2eb-0962ba446e43 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:23.119748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1298251c-fcaa-4638-b2eb-0962ba446e43 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:23.120778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1298251c-fcaa-4638-b2eb-0962ba446e43 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:23.121421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1298251c-fcaa-4638-b2eb-0962ba446e43 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:23.135283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-029f11b6-55b7-4537-95be-6d02ea718b02 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.782916 Apr 19 03:40:23.136230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 193/365] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:40:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:40:23.147621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3deedc48-6361-494e-a31b-7c5c22876ffc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:23.148518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3deedc48-6361-494e-a31b-7c5c22876ffc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:23.262660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-1298251c-fcaa-4638-b2eb-0962ba446e43 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] HTTP exception thrown: Instance 80bfb24e-5dff-4ad3-955d-580cbe4449ed could not be found. Apr 19 03:40:23.269155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1298251c-fcaa-4638-b2eb-0962ba446e43 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] Returning 404 to user: Instance 80bfb24e-5dff-4ad3-955d-580cbe4449ed could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:40:23.269677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1298251c-fcaa-4638-b2eb-0962ba446e43 tempest-VolumesActionsTest-881697916 tempest-VolumesActionsTest-881697916-project] 10.222.0.25 "GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed" status: 404 len: 111 microversion: 2.1 time: 0.175385 Apr 19 03:40:23.270441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 173/366] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:23 2021] GET /compute/v2.1/servers/80bfb24e-5dff-4ad3-955d-580cbe4449ed => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 03:40:23.281655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3deedc48-6361-494e-a31b-7c5c22876ffc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:23.295227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3deedc48-6361-494e-a31b-7c5c22876ffc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1218 microversion: 2.1 time: 0.151065 Apr 19 03:40:23.296043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 194/367] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:23 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:23.420472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-1ed2eddb-a439-4c47-9733-b32b29b74a3d req-70225143-2aa0-4128-8b47-5bf8548ddfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e29b14f0-f43c-434b-b583-cdf6b0e4b784", "tag": "8b1a69d0-ba1e-4994-b669-cc0e63d13b8b"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:23.421230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-17ab5211-4d98-4440-ae57-622a1064cf3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:23.425403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-17ab5211-4d98-4440-ae57-622a1064cf3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:23.425870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:40:23.425870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:40:23.442943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-1ed2eddb-a439-4c47-9733-b32b29b74a3d req-70225143-2aa0-4128-8b47-5bf8548ddfa2 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:23.445290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-17ab5211-4d98-4440-ae57-622a1064cf3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:23.445917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-17ab5211-4d98-4440-ae57-622a1064cf3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:23.446883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-17ab5211-4d98-4440-ae57-622a1064cf3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:23.447529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-17ab5211-4d98-4440-ae57-622a1064cf3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:23.448653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-1ed2eddb-a439-4c47-9733-b32b29b74a3d req-70225143-2aa0-4128-8b47-5bf8548ddfa2 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:23.492598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-1ed2eddb-a439-4c47-9733-b32b29b74a3d req-70225143-2aa0-4128-8b47-5bf8548ddfa2 service nova] Creating event network-changed:8b1a69d0-ba1e-4994-b669-cc0e63d13b8b for instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 on hv-cinder-78605 Apr 19 03:40:23.499651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-1ed2eddb-a439-4c47-9733-b32b29b74a3d req-70225143-2aa0-4128-8b47-5bf8548ddfa2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088365 Apr 19 03:40:23.500848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 195/368] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:40:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:23.512231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f0829f80-db3c-4ac1-9853-ff70a436eeb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:23.514524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f0829f80-db3c-4ac1-9853-ff70a436eeb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:23.523599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0829f80-db3c-4ac1-9853-ff70a436eeb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:23.524485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0829f80-db3c-4ac1-9853-ff70a436eeb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:23.527006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0829f80-db3c-4ac1-9853-ff70a436eeb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:23.528398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0829f80-db3c-4ac1-9853-ff70a436eeb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:23.628131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-17ab5211-4d98-4440-ae57-622a1064cf3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 0.220493 Apr 19 03:40:23.629538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 174/369] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:23 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:23.787637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f0829f80-db3c-4ac1-9853-ff70a436eeb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:23.805553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f0829f80-db3c-4ac1-9853-ff70a436eeb5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.302456 Apr 19 03:40:23.806211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 196/370] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:23 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:24.315015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e5d931e6-5178-4a7f-89e3-8eeeb8a4bd27 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:24.316741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e5d931e6-5178-4a7f-89e3-8eeeb8a4bd27 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:24.326660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5d931e6-5178-4a7f-89e3-8eeeb8a4bd27 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:24.327444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5d931e6-5178-4a7f-89e3-8eeeb8a4bd27 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:24.328443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5d931e6-5178-4a7f-89e3-8eeeb8a4bd27 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:24.329135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5d931e6-5178-4a7f-89e3-8eeeb8a4bd27 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:24.644735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e5d931e6-5178-4a7f-89e3-8eeeb8a4bd27 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:24.648501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f02ad43b-3778-4afe-b76d-d6802c808cba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:24.652772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f02ad43b-3778-4afe-b76d-d6802c808cba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:24.661150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e5d931e6-5178-4a7f-89e3-8eeeb8a4bd27 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1214 microversion: 2.1 time: 0.350916 Apr 19 03:40:24.664107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 175/371] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:24 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:24.668578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f02ad43b-3778-4afe-b76d-d6802c808cba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:24.669853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f02ad43b-3778-4afe-b76d-d6802c808cba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:24.670911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f02ad43b-3778-4afe-b76d-d6802c808cba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:24.671666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f02ad43b-3778-4afe-b76d-d6802c808cba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:24.831118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f02ad43b-3778-4afe-b76d-d6802c808cba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 0.194410 Apr 19 03:40:24.832554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 197/372] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:24 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:24.833435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-86a89777-fb70-4ca8-947d-73c23a727811 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:24.835931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-86a89777-fb70-4ca8-947d-73c23a727811 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:24.846199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86a89777-fb70-4ca8-947d-73c23a727811 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:24.847531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86a89777-fb70-4ca8-947d-73c23a727811 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:24.848831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86a89777-fb70-4ca8-947d-73c23a727811 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:24.849380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86a89777-fb70-4ca8-947d-73c23a727811 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:25.067503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-86a89777-fb70-4ca8-947d-73c23a727811 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:25.077585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-86a89777-fb70-4ca8-947d-73c23a727811 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.257128 Apr 19 03:40:25.078186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 176/373] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:24 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:25.683664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-eafac828-9885-4d36-82d1-5620c5b47519 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:25.684741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-eafac828-9885-4d36-82d1-5620c5b47519 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:25.694134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eafac828-9885-4d36-82d1-5620c5b47519 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:25.694601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eafac828-9885-4d36-82d1-5620c5b47519 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:25.695479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eafac828-9885-4d36-82d1-5620c5b47519 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:25.696031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eafac828-9885-4d36-82d1-5620c5b47519 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:25.834641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-eafac828-9885-4d36-82d1-5620c5b47519 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:25.843929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-24671e79-ff90-46f5-9ea5-a0cfbbd9faf1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:25.844186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-eafac828-9885-4d36-82d1-5620c5b47519 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1278 microversion: 2.1 time: 0.165931 Apr 19 03:40:25.844802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 198/374] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:25 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:25.845135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-24671e79-ff90-46f5-9ea5-a0cfbbd9faf1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:25.853310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24671e79-ff90-46f5-9ea5-a0cfbbd9faf1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:25.853805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24671e79-ff90-46f5-9ea5-a0cfbbd9faf1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:25.855340 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24671e79-ff90-46f5-9ea5-a0cfbbd9faf1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:25.855824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24671e79-ff90-46f5-9ea5-a0cfbbd9faf1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:26.096164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-565f4eb5-4b4f-453b-8021-626dd87ae910 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:26.096760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-565f4eb5-4b4f-453b-8021-626dd87ae910 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:26.105345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-565f4eb5-4b4f-453b-8021-626dd87ae910 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:26.105852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-565f4eb5-4b4f-453b-8021-626dd87ae910 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:26.106681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-565f4eb5-4b4f-453b-8021-626dd87ae910 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:26.107190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-565f4eb5-4b4f-453b-8021-626dd87ae910 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:26.320313 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-565f4eb5-4b4f-453b-8021-626dd87ae910 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:26.330210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-565f4eb5-4b4f-453b-8021-626dd87ae910 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.238205 Apr 19 03:40:26.330832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 199/375] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:26 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:26.863360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-48fa29de-3d98-484e-9bf7-900fc074b7c2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:26.864033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-48fa29de-3d98-484e-9bf7-900fc074b7c2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:26.873029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48fa29de-3d98-484e-9bf7-900fc074b7c2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:26.873520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48fa29de-3d98-484e-9bf7-900fc074b7c2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:26.874376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48fa29de-3d98-484e-9bf7-900fc074b7c2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:26.874873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48fa29de-3d98-484e-9bf7-900fc074b7c2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:26.999044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-48fa29de-3d98-484e-9bf7-900fc074b7c2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:27.007918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-48fa29de-3d98-484e-9bf7-900fc074b7c2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1288 microversion: 2.1 time: 0.149035 Apr 19 03:40:27.008539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 200/376] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:26 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1288 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:27.349231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e447129c-ca12-4d61-8047-ece93683d3fb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:27.349826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e447129c-ca12-4d61-8047-ece93683d3fb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:27.358265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e447129c-ca12-4d61-8047-ece93683d3fb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:27.358769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e447129c-ca12-4d61-8047-ece93683d3fb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:27.359630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e447129c-ca12-4d61-8047-ece93683d3fb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:27.360127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e447129c-ca12-4d61-8047-ece93683d3fb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:27.580900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e447129c-ca12-4d61-8047-ece93683d3fb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:27.591202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e447129c-ca12-4d61-8047-ece93683d3fb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.246105 Apr 19 03:40:27.591833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 201/377] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:27 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:28.026913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bd4b5c7d-2b43-4c3c-a8a8-4a76d77f654f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:28.027717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bd4b5c7d-2b43-4c3c-a8a8-4a76d77f654f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:28.035545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd4b5c7d-2b43-4c3c-a8a8-4a76d77f654f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:28.036048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd4b5c7d-2b43-4c3c-a8a8-4a76d77f654f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:28.036869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd4b5c7d-2b43-4c3c-a8a8-4a76d77f654f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:28.037356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd4b5c7d-2b43-4c3c-a8a8-4a76d77f654f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:28.162607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bd4b5c7d-2b43-4c3c-a8a8-4a76d77f654f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:28.172432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bd4b5c7d-2b43-4c3c-a8a8-4a76d77f654f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1288 microversion: 2.1 time: 0.150311 Apr 19 03:40:28.173057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 202/378] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:28 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1288 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:28.610712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8b9b4740-9482-4663-9bf1-e9be39226ec5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:28.611782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8b9b4740-9482-4663-9bf1-e9be39226ec5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:28.619717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b9b4740-9482-4663-9bf1-e9be39226ec5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:28.620778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b9b4740-9482-4663-9bf1-e9be39226ec5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:28.621610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b9b4740-9482-4663-9bf1-e9be39226ec5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:28.622103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b9b4740-9482-4663-9bf1-e9be39226ec5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:28.844228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8b9b4740-9482-4663-9bf1-e9be39226ec5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:28.853812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8b9b4740-9482-4663-9bf1-e9be39226ec5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.247117 Apr 19 03:40:28.855068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 203/379] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:28 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:29.109049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-24671e79-ff90-46f5-9ea5-a0cfbbd9faf1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 3.268936 Apr 19 03:40:29.109726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 177/380] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:25 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 3271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:29.190854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-522d5c09-6939-416a-a6d7-d43acf409e0c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:29.192000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-522d5c09-6939-416a-a6d7-d43acf409e0c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:29.201387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-522d5c09-6939-416a-a6d7-d43acf409e0c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:29.201926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-522d5c09-6939-416a-a6d7-d43acf409e0c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:29.202783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-522d5c09-6939-416a-a6d7-d43acf409e0c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:29.203476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-522d5c09-6939-416a-a6d7-d43acf409e0c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:29.334431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-522d5c09-6939-416a-a6d7-d43acf409e0c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:29.343989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-522d5c09-6939-416a-a6d7-d43acf409e0c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1276 microversion: 2.1 time: 0.157540 Apr 19 03:40:29.344619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 204/381] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:29 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:29.874001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c3aa9cd1-65b0-42b9-a571-c284b66f4145 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:29.874812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c3aa9cd1-65b0-42b9-a571-c284b66f4145 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:29.883035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3aa9cd1-65b0-42b9-a571-c284b66f4145 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:29.883561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3aa9cd1-65b0-42b9-a571-c284b66f4145 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:29.884377 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3aa9cd1-65b0-42b9-a571-c284b66f4145 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:29.884863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3aa9cd1-65b0-42b9-a571-c284b66f4145 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:30.121806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-874a7cd5-6e79-4c62-840c-0bc2d0c9f870 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:30.122857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-874a7cd5-6e79-4c62-840c-0bc2d0c9f870 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:30.130845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-874a7cd5-6e79-4c62-840c-0bc2d0c9f870 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:30.131460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-874a7cd5-6e79-4c62-840c-0bc2d0c9f870 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:30.132369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-874a7cd5-6e79-4c62-840c-0bc2d0c9f870 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:30.132922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-874a7cd5-6e79-4c62-840c-0bc2d0c9f870 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:30.250889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-874a7cd5-6e79-4c62-840c-0bc2d0c9f870 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 0.133064 Apr 19 03:40:30.253882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 205/382] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:30 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:30.310636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c3aa9cd1-65b0-42b9-a571-c284b66f4145 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:30.322395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c3aa9cd1-65b0-42b9-a571-c284b66f4145 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.453351 Apr 19 03:40:30.325240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 178/383] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:29 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:30.363028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c8049d72-e27d-41d7-9fb3-68c271e7e6f6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:30.363877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c8049d72-e27d-41d7-9fb3-68c271e7e6f6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:30.372528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8049d72-e27d-41d7-9fb3-68c271e7e6f6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:30.373010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8049d72-e27d-41d7-9fb3-68c271e7e6f6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:30.374427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8049d72-e27d-41d7-9fb3-68c271e7e6f6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:30.375248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8049d72-e27d-41d7-9fb3-68c271e7e6f6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:30.650076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c8049d72-e27d-41d7-9fb3-68c271e7e6f6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:30.660611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c8049d72-e27d-41d7-9fb3-68c271e7e6f6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1318 microversion: 2.1 time: 0.302287 Apr 19 03:40:30.661259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 206/384] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:30 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:31.239828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6f105cd0-7c2b-4fee-9a8a-a2280cdbda56 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:31.241642 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6f105cd0-7c2b-4fee-9a8a-a2280cdbda56 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:31.263217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9a63d121-0fd8-4bf8-a1e7-d98027737328 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:31.264285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f105cd0-7c2b-4fee-9a8a-a2280cdbda56 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:31.264937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9a63d121-0fd8-4bf8-a1e7-d98027737328 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:31.265125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f105cd0-7c2b-4fee-9a8a-a2280cdbda56 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:31.266414 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f105cd0-7c2b-4fee-9a8a-a2280cdbda56 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:31.267365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f105cd0-7c2b-4fee-9a8a-a2280cdbda56 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:31.286045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a63d121-0fd8-4bf8-a1e7-d98027737328 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:31.286754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a63d121-0fd8-4bf8-a1e7-d98027737328 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:31.288719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a63d121-0fd8-4bf8-a1e7-d98027737328 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:31.290036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a63d121-0fd8-4bf8-a1e7-d98027737328 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:31.355408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-6f105cd0-7c2b-4fee-9a8a-a2280cdbda56 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lazy-loading 'flavor' on Instance uuid 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:40:31.435498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9a63d121-0fd8-4bf8-a1e7-d98027737328 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 0.176593 Apr 19 03:40:31.436324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 207/385] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:31 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:31.443401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bf6ed1dd-1ac9-404f-a12c-fa61c7a6a377 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:31.445911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bf6ed1dd-1ac9-404f-a12c-fa61c7a6a377 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:31.468350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf6ed1dd-1ac9-404f-a12c-fa61c7a6a377 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:31.474068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf6ed1dd-1ac9-404f-a12c-fa61c7a6a377 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:31.474800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf6ed1dd-1ac9-404f-a12c-fa61c7a6a377 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:31.475734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf6ed1dd-1ac9-404f-a12c-fa61c7a6a377 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:31.819923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bf6ed1dd-1ac9-404f-a12c-fa61c7a6a377 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:31.833072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bf6ed1dd-1ac9-404f-a12c-fa61c7a6a377 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.394803 Apr 19 03:40:31.846743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 208/386] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:31 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:31.852051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-731d6781-7e7d-4daa-b369-19284765850c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:31.852801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-731d6781-7e7d-4daa-b369-19284765850c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:31.866076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-731d6781-7e7d-4daa-b369-19284765850c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:31.866592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-731d6781-7e7d-4daa-b369-19284765850c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:31.867495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-731d6781-7e7d-4daa-b369-19284765850c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:31.868061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-731d6781-7e7d-4daa-b369-19284765850c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:31.981957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6f105cd0-7c2b-4fee-9a8a-a2280cdbda56 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/action" status: 200 len: 32 microversion: 2.1 time: 0.747537 Apr 19 03:40:31.983029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 179/387] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:40:31 2021] POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/action => generated 32 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:40:31.997387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-88016fa1-5b24-4013-9db9-6ac2fc93ade7 req-77c09152-b349-4c33-abcf-da8641df4b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcad7e0c-ccda-4c71-a827-bcd885cd3b4f", "tag": "5a6ffccc-34e3-42cc-a465-b55f727291e9"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:31.999290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:40:31.999290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:40:32.020193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-88016fa1-5b24-4013-9db9-6ac2fc93ade7 req-77c09152-b349-4c33-abcf-da8641df4b07 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:32.020399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-88016fa1-5b24-4013-9db9-6ac2fc93ade7 req-77c09152-b349-4c33-abcf-da8641df4b07 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:32.065819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-88016fa1-5b24-4013-9db9-6ac2fc93ade7 req-77c09152-b349-4c33-abcf-da8641df4b07 service nova] Creating event network-changed:5a6ffccc-34e3-42cc-a465-b55f727291e9 for instance fcad7e0c-ccda-4c71-a827-bcd885cd3b4f on hv-cinder-78605 Apr 19 03:40:32.090998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-88016fa1-5b24-4013-9db9-6ac2fc93ade7 req-77c09152-b349-4c33-abcf-da8641df4b07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106040 Apr 19 03:40:32.097333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 180/388] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:40:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:32.103448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-acd89539-c9b6-4bc2-9442-9267ed3e0b82 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:32.104277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-acd89539-c9b6-4bc2-9442-9267ed3e0b82 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:32.132860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-acd89539-c9b6-4bc2-9442-9267ed3e0b82 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:32.133405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-acd89539-c9b6-4bc2-9442-9267ed3e0b82 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:32.134302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-acd89539-c9b6-4bc2-9442-9267ed3e0b82 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:32.134800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-acd89539-c9b6-4bc2-9442-9267ed3e0b82 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:32.273332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-731d6781-7e7d-4daa-b369-19284765850c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:32.284919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-731d6781-7e7d-4daa-b369-19284765850c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1318 microversion: 2.1 time: 0.436905 Apr 19 03:40:32.285836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 209/389] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:31 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:32.450277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0cd721d9-3a01-41a6-835d-f487b214f52a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:32.458496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0cd721d9-3a01-41a6-835d-f487b214f52a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:32.471324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cd721d9-3a01-41a6-835d-f487b214f52a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:32.472411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cd721d9-3a01-41a6-835d-f487b214f52a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:32.473890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cd721d9-3a01-41a6-835d-f487b214f52a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:32.474952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cd721d9-3a01-41a6-835d-f487b214f52a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:32.600192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0cd721d9-3a01-41a6-835d-f487b214f52a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 0.157504 Apr 19 03:40:32.601073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 210/390] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:32 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:32.852249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7b4f53f-c6f5-4b29-a729-df8da3812210 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:32.852954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b7b4f53f-c6f5-4b29-a729-df8da3812210 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:32.861802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7b4f53f-c6f5-4b29-a729-df8da3812210 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:32.862313 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7b4f53f-c6f5-4b29-a729-df8da3812210 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:32.863182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7b4f53f-c6f5-4b29-a729-df8da3812210 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:32.863680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7b4f53f-c6f5-4b29-a729-df8da3812210 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:33.045437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-acd89539-c9b6-4bc2-9442-9267ed3e0b82 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:33.056758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-acd89539-c9b6-4bc2-9442-9267ed3e0b82 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.957991 Apr 19 03:40:33.058139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 181/391] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:32 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:33.100469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b7b4f53f-c6f5-4b29-a729-df8da3812210 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:33.112040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b7b4f53f-c6f5-4b29-a729-df8da3812210 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.264551 Apr 19 03:40:33.112852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 211/392] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:32 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:33.305123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d2610a36-c329-43b5-bc60-69828c83eb21 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:33.306590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d2610a36-c329-43b5-bc60-69828c83eb21 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:33.315923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2610a36-c329-43b5-bc60-69828c83eb21 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:33.316643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2610a36-c329-43b5-bc60-69828c83eb21 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:33.317535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2610a36-c329-43b5-bc60-69828c83eb21 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:33.318217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2610a36-c329-43b5-bc60-69828c83eb21 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:33.615046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e61d48d0-5f0b-4bb7-a302-359126baa8a7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:33.616417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e61d48d0-5f0b-4bb7-a302-359126baa8a7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:33.629503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e61d48d0-5f0b-4bb7-a302-359126baa8a7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:33.630026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e61d48d0-5f0b-4bb7-a302-359126baa8a7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:33.630879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e61d48d0-5f0b-4bb7-a302-359126baa8a7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:33.631557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e61d48d0-5f0b-4bb7-a302-359126baa8a7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:33.777637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e61d48d0-5f0b-4bb7-a302-359126baa8a7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 0.167426 Apr 19 03:40:33.781657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 212/393] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:33 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:34.078041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-eeb6b690-72e7-4c24-b169-8a5952ee84a5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:34.079271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-eeb6b690-72e7-4c24-b169-8a5952ee84a5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:34.090137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eeb6b690-72e7-4c24-b169-8a5952ee84a5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:34.090740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eeb6b690-72e7-4c24-b169-8a5952ee84a5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:34.091725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eeb6b690-72e7-4c24-b169-8a5952ee84a5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:34.092584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eeb6b690-72e7-4c24-b169-8a5952ee84a5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:34.234230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d2610a36-c329-43b5-bc60-69828c83eb21 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:34.248930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d2610a36-c329-43b5-bc60-69828c83eb21 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1318 microversion: 2.1 time: 0.948365 Apr 19 03:40:34.249704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 182/394] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:33 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1318 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:34.265948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-12a6bbd0-d199-4de0-b30b-7240f25f84e3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:34.266606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-12a6bbd0-d199-4de0-b30b-7240f25f84e3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:34.282872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12a6bbd0-d199-4de0-b30b-7240f25f84e3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:34.283708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12a6bbd0-d199-4de0-b30b-7240f25f84e3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:34.284709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12a6bbd0-d199-4de0-b30b-7240f25f84e3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:34.285340 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12a6bbd0-d199-4de0-b30b-7240f25f84e3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:34.353007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-eeb6b690-72e7-4c24-b169-8a5952ee84a5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:34.384456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-eeb6b690-72e7-4c24-b169-8a5952ee84a5 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.311889 Apr 19 03:40:34.391768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 213/395] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:34 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:34.705584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-12a6bbd0-d199-4de0-b30b-7240f25f84e3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:34.716193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-12a6bbd0-d199-4de0-b30b-7240f25f84e3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.465380 Apr 19 03:40:34.717558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 183/396] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:34 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:34.790380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6c34499b-50b3-41e2-bc0d-c62b277144c2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:34.791668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6c34499b-50b3-41e2-bc0d-c62b277144c2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:34.800407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c34499b-50b3-41e2-bc0d-c62b277144c2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:34.801053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c34499b-50b3-41e2-bc0d-c62b277144c2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:34.802100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c34499b-50b3-41e2-bc0d-c62b277144c2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:34.802805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c34499b-50b3-41e2-bc0d-c62b277144c2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:35.029474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6c34499b-50b3-41e2-bc0d-c62b277144c2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 0.243166 Apr 19 03:40:35.033052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 214/397] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:34 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:35.266413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-82e7ab21-94e4-4460-b393-3549d930bbec tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:35.267212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-82e7ab21-94e4-4460-b393-3549d930bbec tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:35.275160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82e7ab21-94e4-4460-b393-3549d930bbec tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:35.275684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82e7ab21-94e4-4460-b393-3549d930bbec tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:35.276519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82e7ab21-94e4-4460-b393-3549d930bbec tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:35.277007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82e7ab21-94e4-4460-b393-3549d930bbec tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:35.410494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b595ebd6-1bf2-48aa-8513-934d927aa231 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:35.411310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b595ebd6-1bf2-48aa-8513-934d927aa231 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:35.426727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b595ebd6-1bf2-48aa-8513-934d927aa231 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:35.427288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b595ebd6-1bf2-48aa-8513-934d927aa231 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:35.429315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b595ebd6-1bf2-48aa-8513-934d927aa231 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:35.433864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b595ebd6-1bf2-48aa-8513-934d927aa231 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:35.660423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-82e7ab21-94e4-4460-b393-3549d930bbec tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:35.679726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-82e7ab21-94e4-4460-b393-3549d930bbec tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1318 microversion: 2.1 time: 0.412628 Apr 19 03:40:35.703095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 184/398] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:35 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:35.734319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0ee3ed93-d28a-419d-9661-10b8f1343f3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:35.734984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0ee3ed93-d28a-419d-9661-10b8f1343f3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:35.749626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ee3ed93-d28a-419d-9661-10b8f1343f3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:35.750136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ee3ed93-d28a-419d-9661-10b8f1343f3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:35.750992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ee3ed93-d28a-419d-9661-10b8f1343f3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:35.751506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ee3ed93-d28a-419d-9661-10b8f1343f3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:35.782974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b595ebd6-1bf2-48aa-8513-934d927aa231 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:35.796894 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b595ebd6-1bf2-48aa-8513-934d927aa231 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.391370 Apr 19 03:40:35.805542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 215/399] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:35 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:36.020795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0ee3ed93-d28a-419d-9661-10b8f1343f3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:36.030936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0ee3ed93-d28a-419d-9661-10b8f1343f3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.300981 Apr 19 03:40:36.031675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 185/400] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:35 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:36.041209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-05c7c4da-c08f-4b27-a7bb-793f988e1345 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:36.042357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-05c7c4da-c08f-4b27-a7bb-793f988e1345 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:36.051412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05c7c4da-c08f-4b27-a7bb-793f988e1345 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:36.051927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05c7c4da-c08f-4b27-a7bb-793f988e1345 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:36.053066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05c7c4da-c08f-4b27-a7bb-793f988e1345 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:36.053560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05c7c4da-c08f-4b27-a7bb-793f988e1345 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:36.163135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-05c7c4da-c08f-4b27-a7bb-793f988e1345 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 0.125757 Apr 19 03:40:36.166724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 216/401] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:36 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:36.710649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-38540b4a-651f-4363-bc2f-797109225516 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:36.711355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-38540b4a-651f-4363-bc2f-797109225516 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:36.719324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38540b4a-651f-4363-bc2f-797109225516 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:36.719837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38540b4a-651f-4363-bc2f-797109225516 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:36.720668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38540b4a-651f-4363-bc2f-797109225516 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:36.721157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38540b4a-651f-4363-bc2f-797109225516 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:36.817505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-34d8334e-ce67-4bf5-a286-be31fc5223d7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:36.818672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-34d8334e-ce67-4bf5-a286-be31fc5223d7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:36.830484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34d8334e-ce67-4bf5-a286-be31fc5223d7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:36.831002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34d8334e-ce67-4bf5-a286-be31fc5223d7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:36.831919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34d8334e-ce67-4bf5-a286-be31fc5223d7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:36.832591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34d8334e-ce67-4bf5-a286-be31fc5223d7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:36.995123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-38540b4a-651f-4363-bc2f-797109225516 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:37.009192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-38540b4a-651f-4363-bc2f-797109225516 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1318 microversion: 2.1 time: 0.302303 Apr 19 03:40:37.009864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 186/402] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:36 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:37.049687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f514ed1a-5632-406e-811e-7594bac4c82b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:37.050644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f514ed1a-5632-406e-811e-7594bac4c82b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:37.059945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f514ed1a-5632-406e-811e-7594bac4c82b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:37.060662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f514ed1a-5632-406e-811e-7594bac4c82b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:37.061584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f514ed1a-5632-406e-811e-7594bac4c82b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:37.062140 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f514ed1a-5632-406e-811e-7594bac4c82b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:37.171925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-34d8334e-ce67-4bf5-a286-be31fc5223d7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:37.186229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-34d8334e-ce67-4bf5-a286-be31fc5223d7 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.374956 Apr 19 03:40:37.187381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 217/403] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:36 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:37.192796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-320591c3-8ca6-43ab-9976-662e7420e9ef tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:37.194814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-320591c3-8ca6-43ab-9976-662e7420e9ef tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:37.203594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-320591c3-8ca6-43ab-9976-662e7420e9ef tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:37.204480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-320591c3-8ca6-43ab-9976-662e7420e9ef tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:37.205527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-320591c3-8ca6-43ab-9976-662e7420e9ef tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:37.206229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-320591c3-8ca6-43ab-9976-662e7420e9ef tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:37.357197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-320591c3-8ca6-43ab-9976-662e7420e9ef tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 0.167990 Apr 19 03:40:37.358135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 218/404] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:37 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:37.366173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f514ed1a-5632-406e-811e-7594bac4c82b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:37.378296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f514ed1a-5632-406e-811e-7594bac4c82b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.332807 Apr 19 03:40:37.379265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 187/405] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:37 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:38.031323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6d02b390-7d79-499b-90cb-e5b5b7ec0e84 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:38.032165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6d02b390-7d79-499b-90cb-e5b5b7ec0e84 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:38.042391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d02b390-7d79-499b-90cb-e5b5b7ec0e84 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:38.043036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d02b390-7d79-499b-90cb-e5b5b7ec0e84 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:38.043960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d02b390-7d79-499b-90cb-e5b5b7ec0e84 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:38.044513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d02b390-7d79-499b-90cb-e5b5b7ec0e84 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:38.205572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2e0ad0af-110c-4bf7-9da6-ee4ea005405a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:38.206635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2e0ad0af-110c-4bf7-9da6-ee4ea005405a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:38.215374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2e0ad0af-110c-4bf7-9da6-ee4ea005405a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:38.215968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2e0ad0af-110c-4bf7-9da6-ee4ea005405a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:38.216918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2e0ad0af-110c-4bf7-9da6-ee4ea005405a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:38.217346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2e0ad0af-110c-4bf7-9da6-ee4ea005405a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:38.322218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6d02b390-7d79-499b-90cb-e5b5b7ec0e84 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:38.332439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6d02b390-7d79-499b-90cb-e5b5b7ec0e84 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1318 microversion: 2.1 time: 0.305933 Apr 19 03:40:38.333389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 219/406] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:38 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:38.372680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-79991634-5338-469b-a04d-3f079f041b3d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:38.374767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-79991634-5338-469b-a04d-3f079f041b3d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:38.389525 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79991634-5338-469b-a04d-3f079f041b3d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:38.390690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79991634-5338-469b-a04d-3f079f041b3d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:38.394544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79991634-5338-469b-a04d-3f079f041b3d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:38.395515 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79991634-5338-469b-a04d-3f079f041b3d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:38.487338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2e0ad0af-110c-4bf7-9da6-ee4ea005405a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:38.500493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2e0ad0af-110c-4bf7-9da6-ee4ea005405a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.298726 Apr 19 03:40:38.501064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 188/407] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:38 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:38.506004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-294eaf37-369a-4423-9cc4-6ec5403009f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:38.507037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-294eaf37-369a-4423-9cc4-6ec5403009f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:38.519540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-294eaf37-369a-4423-9cc4-6ec5403009f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:38.520041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-294eaf37-369a-4423-9cc4-6ec5403009f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:38.521281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-294eaf37-369a-4423-9cc4-6ec5403009f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:38.521779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-294eaf37-369a-4423-9cc4-6ec5403009f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:38.573996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-79991634-5338-469b-a04d-3f079f041b3d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 14 microversion: 2.20 time: 0.207496 Apr 19 03:40:38.574760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 220/408] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:38 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:38.771087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-294eaf37-369a-4423-9cc4-6ec5403009f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:38.782389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-294eaf37-369a-4423-9cc4-6ec5403009f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.279923 Apr 19 03:40:38.783253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 189/409] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:38 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:39.353166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-45c4422f-2aa7-4c43-b645-628e085e9c58 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:39.354913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-45c4422f-2aa7-4c43-b645-628e085e9c58 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:39.365395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45c4422f-2aa7-4c43-b645-628e085e9c58 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:39.366126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45c4422f-2aa7-4c43-b645-628e085e9c58 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:39.367939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45c4422f-2aa7-4c43-b645-628e085e9c58 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:39.368681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45c4422f-2aa7-4c43-b645-628e085e9c58 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:39.518182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1f070335-121d-48c9-80df-8dcfcbf48632 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:39.518859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1f070335-121d-48c9-80df-8dcfcbf48632 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:39.527712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f070335-121d-48c9-80df-8dcfcbf48632 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:39.528218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f070335-121d-48c9-80df-8dcfcbf48632 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:39.529274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f070335-121d-48c9-80df-8dcfcbf48632 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:39.529772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f070335-121d-48c9-80df-8dcfcbf48632 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:39.808008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1f070335-121d-48c9-80df-8dcfcbf48632 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:39.809954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-45c4422f-2aa7-4c43-b645-628e085e9c58 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:39.820389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1f070335-121d-48c9-80df-8dcfcbf48632 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.306281 Apr 19 03:40:39.835505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 190/410] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:39 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:39.835659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-45c4422f-2aa7-4c43-b645-628e085e9c58 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1318 microversion: 2.1 time: 0.476640 Apr 19 03:40:39.835659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 221/411] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:39 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:39.835826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3d9f50b2-0bf7-4633-9c61-992ed9f5ff09 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:39.835826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3d9f50b2-0bf7-4633-9c61-992ed9f5ff09 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:39.835981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7d58eed4-5baa-4796-9129-963ce60de6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:39.835981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7d58eed4-5baa-4796-9129-963ce60de6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:39.839188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d9f50b2-0bf7-4633-9c61-992ed9f5ff09 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:39.839188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d9f50b2-0bf7-4633-9c61-992ed9f5ff09 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:39.839188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d9f50b2-0bf7-4633-9c61-992ed9f5ff09 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:39.839188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d9f50b2-0bf7-4633-9c61-992ed9f5ff09 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:39.849414 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7d58eed4-5baa-4796-9129-963ce60de6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:39.850567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7d58eed4-5baa-4796-9129-963ce60de6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:39.851739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7d58eed4-5baa-4796-9129-963ce60de6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:39.852460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7d58eed4-5baa-4796-9129-963ce60de6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:40.005688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3d9f50b2-0bf7-4633-9c61-992ed9f5ff09 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 6451 microversion: 2.20 time: 0.182441 Apr 19 03:40:40.018316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 191/412] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:39 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 6451 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:40:40.145078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7d58eed4-5baa-4796-9129-963ce60de6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:40.156601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7d58eed4-5baa-4796-9129-963ce60de6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.328722 Apr 19 03:40:40.157247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 222/413] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:39 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:40.597728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-c5e574af-10bb-4552-9445-1b8776ba52a6 req-e9a88626-0418-445a-96b0-199caf26c690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcad7e0c-ccda-4c71-a827-bcd885cd3b4f", "name": "network-vif-plugged", "status": "completed", "tag": "5a6ffccc-34e3-42cc-a465-b55f727291e9"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:40.600138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:40:40.600138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:40:40.623265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-c5e574af-10bb-4552-9445-1b8776ba52a6 req-e9a88626-0418-445a-96b0-199caf26c690 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:40.623866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-c5e574af-10bb-4552-9445-1b8776ba52a6 req-e9a88626-0418-445a-96b0-199caf26c690 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:40.643535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-c5e574af-10bb-4552-9445-1b8776ba52a6 req-e9a88626-0418-445a-96b0-199caf26c690 service nova] Creating event network-vif-plugged:5a6ffccc-34e3-42cc-a465-b55f727291e9 for instance fcad7e0c-ccda-4c71-a827-bcd885cd3b4f on hv-cinder-78605 Apr 19 03:40:40.648705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-c5e574af-10bb-4552-9445-1b8776ba52a6 req-e9a88626-0418-445a-96b0-199caf26c690 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055537 Apr 19 03:40:40.649362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 192/414] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:40:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:40.852210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-31794a30-1763-4f70-bc9d-68ed19108d87 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:40.853403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-31794a30-1763-4f70-bc9d-68ed19108d87 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:40.854252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-60e62fce-2877-41c5-a13e-8fd1c5b5eda0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:40.855014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-60e62fce-2877-41c5-a13e-8fd1c5b5eda0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:40.866822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31794a30-1763-4f70-bc9d-68ed19108d87 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:40.867358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31794a30-1763-4f70-bc9d-68ed19108d87 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:40.873805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31794a30-1763-4f70-bc9d-68ed19108d87 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:40.874474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31794a30-1763-4f70-bc9d-68ed19108d87 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:40.877596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60e62fce-2877-41c5-a13e-8fd1c5b5eda0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:40.878336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60e62fce-2877-41c5-a13e-8fd1c5b5eda0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:40.879556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60e62fce-2877-41c5-a13e-8fd1c5b5eda0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:40.880157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60e62fce-2877-41c5-a13e-8fd1c5b5eda0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:41.220609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-60e62fce-2877-41c5-a13e-8fd1c5b5eda0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:41.232024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-60e62fce-2877-41c5-a13e-8fd1c5b5eda0 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.386329 Apr 19 03:40:41.232697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 223/415] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:40 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:41.247787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-559ebb31-3ec8-4eb3-9cd5-75c2f7e9beba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:41.252814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-559ebb31-3ec8-4eb3-9cd5-75c2f7e9beba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:41.274334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-559ebb31-3ec8-4eb3-9cd5-75c2f7e9beba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:41.275956 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-559ebb31-3ec8-4eb3-9cd5-75c2f7e9beba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:41.277991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-559ebb31-3ec8-4eb3-9cd5-75c2f7e9beba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:41.278822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-559ebb31-3ec8-4eb3-9cd5-75c2f7e9beba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:41.281100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-31794a30-1763-4f70-bc9d-68ed19108d87 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:41.290809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-31794a30-1763-4f70-bc9d-68ed19108d87 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1318 microversion: 2.1 time: 0.443300 Apr 19 03:40:41.291963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 193/416] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:40 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:41.303460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1c47c172-eb60-48e8-a889-396aff92249e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:41.304147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1c47c172-eb60-48e8-a889-396aff92249e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:41.312489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c47c172-eb60-48e8-a889-396aff92249e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:41.313003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c47c172-eb60-48e8-a889-396aff92249e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:41.313852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c47c172-eb60-48e8-a889-396aff92249e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:41.314357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c47c172-eb60-48e8-a889-396aff92249e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:41.484186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-559ebb31-3ec8-4eb3-9cd5-75c2f7e9beba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 13887 microversion: 2.20 time: 0.250054 Apr 19 03:40:41.488438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 224/417] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:41 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 13887 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:40:41.572192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1c47c172-eb60-48e8-a889-396aff92249e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:41.583524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1c47c172-eb60-48e8-a889-396aff92249e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.284132 Apr 19 03:40:41.584290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 194/418] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:41 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:42.251704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a5b125e9-620e-46f2-abd2-801522465d6e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:42.252526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a5b125e9-620e-46f2-abd2-801522465d6e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:42.261260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5b125e9-620e-46f2-abd2-801522465d6e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:42.261776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5b125e9-620e-46f2-abd2-801522465d6e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:42.262618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5b125e9-620e-46f2-abd2-801522465d6e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:42.263111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5b125e9-620e-46f2-abd2-801522465d6e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:42.309983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f5f9e403-6311-4b17-91e9-0aca279fa9f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:42.310653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f5f9e403-6311-4b17-91e9-0aca279fa9f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:42.319901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5f9e403-6311-4b17-91e9-0aca279fa9f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:42.320408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5f9e403-6311-4b17-91e9-0aca279fa9f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:42.321241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5f9e403-6311-4b17-91e9-0aca279fa9f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:42.321733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5f9e403-6311-4b17-91e9-0aca279fa9f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:42.638307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f5f9e403-6311-4b17-91e9-0aca279fa9f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:42.648359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f5f9e403-6311-4b17-91e9-0aca279fa9f7 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1318 microversion: 2.1 time: 0.343094 Apr 19 03:40:42.648985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 195/419] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:42 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:42.657539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-09b05ad4-b1da-4612-a0cb-fc69ea865d07 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:42.659741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-09b05ad4-b1da-4612-a0cb-fc69ea865d07 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:42.671026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09b05ad4-b1da-4612-a0cb-fc69ea865d07 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:42.671559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09b05ad4-b1da-4612-a0cb-fc69ea865d07 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:42.672641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09b05ad4-b1da-4612-a0cb-fc69ea865d07 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:42.673157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09b05ad4-b1da-4612-a0cb-fc69ea865d07 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:42.774036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a5b125e9-620e-46f2-abd2-801522465d6e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:42.785395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a5b125e9-620e-46f2-abd2-801522465d6e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.538300 Apr 19 03:40:42.786190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 225/420] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:42 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:42.792254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3ec7097b-9525-46c6-a68f-79de5d4f51e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:42.793007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3ec7097b-9525-46c6-a68f-79de5d4f51e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:42.802823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ec7097b-9525-46c6-a68f-79de5d4f51e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:42.802823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ec7097b-9525-46c6-a68f-79de5d4f51e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:42.803284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ec7097b-9525-46c6-a68f-79de5d4f51e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:42.803771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ec7097b-9525-46c6-a68f-79de5d4f51e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:42.815697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-09b05ad4-b1da-4612-a0cb-fc69ea865d07 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 16877 microversion: 2.20 time: 0.165000 Apr 19 03:40:42.816407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 196/421] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:42 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 16877 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:40:43.036656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3ec7097b-9525-46c6-a68f-79de5d4f51e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:43.046766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3ec7097b-9525-46c6-a68f-79de5d4f51e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.259427 Apr 19 03:40:43.047432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 226/422] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:42 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:43.669641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dff06fa9-e5a6-4427-8573-0e05918554d6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:43.670550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dff06fa9-e5a6-4427-8573-0e05918554d6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:43.682779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dff06fa9-e5a6-4427-8573-0e05918554d6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:43.683315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dff06fa9-e5a6-4427-8573-0e05918554d6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:43.684329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dff06fa9-e5a6-4427-8573-0e05918554d6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:43.684959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dff06fa9-e5a6-4427-8573-0e05918554d6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:43.810019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7675245e-50a8-4473-8cc3-e8ace7814453 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:43.811044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7675245e-50a8-4473-8cc3-e8ace7814453 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:43.820083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7675245e-50a8-4473-8cc3-e8ace7814453 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:43.820936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7675245e-50a8-4473-8cc3-e8ace7814453 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:43.822018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7675245e-50a8-4473-8cc3-e8ace7814453 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:43.823336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7675245e-50a8-4473-8cc3-e8ace7814453 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:43.926510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dff06fa9-e5a6-4427-8573-0e05918554d6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:43.937369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dff06fa9-e5a6-4427-8573-0e05918554d6 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1507 microversion: 2.1 time: 0.274683 Apr 19 03:40:43.938210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 197/423] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:43 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:43.943745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ca270514-6857-4577-97af-a9c3ab7d846e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:43.944979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ca270514-6857-4577-97af-a9c3ab7d846e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:43.954220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca270514-6857-4577-97af-a9c3ab7d846e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:43.954938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca270514-6857-4577-97af-a9c3ab7d846e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:43.955950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca270514-6857-4577-97af-a9c3ab7d846e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:43.956639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca270514-6857-4577-97af-a9c3ab7d846e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:44.073635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7675245e-50a8-4473-8cc3-e8ace7814453 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:44.084295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7675245e-50a8-4473-8cc3-e8ace7814453 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.280590 Apr 19 03:40:44.084988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 227/424] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:43 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:44.090530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-843b89b5-4b76-4175-92fc-5e511fd088ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:44.091384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-843b89b5-4b76-4175-92fc-5e511fd088ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:44.099384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-843b89b5-4b76-4175-92fc-5e511fd088ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:44.100114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-843b89b5-4b76-4175-92fc-5e511fd088ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:44.101111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-843b89b5-4b76-4175-92fc-5e511fd088ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:44.101912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-843b89b5-4b76-4175-92fc-5e511fd088ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:44.346922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-843b89b5-4b76-4175-92fc-5e511fd088ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:44.358803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-843b89b5-4b76-4175-92fc-5e511fd088ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.272685 Apr 19 03:40:44.363431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 228/425] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:44 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:45.104373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fe0f2c2b-ed78-45e4-8843-fd71d133d630 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:45.105049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fe0f2c2b-ed78-45e4-8843-fd71d133d630 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:45.113223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe0f2c2b-ed78-45e4-8843-fd71d133d630 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:45.113735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe0f2c2b-ed78-45e4-8843-fd71d133d630 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:45.114571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe0f2c2b-ed78-45e4-8843-fd71d133d630 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:45.115068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe0f2c2b-ed78-45e4-8843-fd71d133d630 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:45.320932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fe0f2c2b-ed78-45e4-8843-fd71d133d630 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:45.330375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fe0f2c2b-ed78-45e4-8843-fd71d133d630 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.230771 Apr 19 03:40:45.330911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 229/426] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:45 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:45.376795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2b1fa53d-37c2-4d39-947a-1f2ed381bf89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:45.377469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2b1fa53d-37c2-4d39-947a-1f2ed381bf89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:45.385091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2b1fa53d-37c2-4d39-947a-1f2ed381bf89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:45.385596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2b1fa53d-37c2-4d39-947a-1f2ed381bf89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:45.386417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2b1fa53d-37c2-4d39-947a-1f2ed381bf89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:45.386906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2b1fa53d-37c2-4d39-947a-1f2ed381bf89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:45.602648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2b1fa53d-37c2-4d39-947a-1f2ed381bf89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:45.616717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2b1fa53d-37c2-4d39-947a-1f2ed381bf89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.240339 Apr 19 03:40:45.616717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 230/427] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:45 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:46.348634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c9bef0bf-c44d-477d-a3e9-688f8581828c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:46.349342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c9bef0bf-c44d-477d-a3e9-688f8581828c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:46.357721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c9bef0bf-c44d-477d-a3e9-688f8581828c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:46.358209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c9bef0bf-c44d-477d-a3e9-688f8581828c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:46.359033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c9bef0bf-c44d-477d-a3e9-688f8581828c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:46.359548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c9bef0bf-c44d-477d-a3e9-688f8581828c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:46.569599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c9bef0bf-c44d-477d-a3e9-688f8581828c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:46.579392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c9bef0bf-c44d-477d-a3e9-688f8581828c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.234800 Apr 19 03:40:46.580020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 231/428] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:46 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:46.633249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e81667cc-2d33-44d5-b78e-439664f279d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:46.633856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e81667cc-2d33-44d5-b78e-439664f279d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:46.641900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e81667cc-2d33-44d5-b78e-439664f279d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:46.642398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e81667cc-2d33-44d5-b78e-439664f279d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:46.643276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e81667cc-2d33-44d5-b78e-439664f279d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:46.643764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e81667cc-2d33-44d5-b78e-439664f279d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:46.857243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e81667cc-2d33-44d5-b78e-439664f279d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:46.867303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e81667cc-2d33-44d5-b78e-439664f279d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.238246 Apr 19 03:40:46.867927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 232/429] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:46 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:47.597621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-22f095a4-597c-4c65-acc2-d9ef6b46fb22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:47.598274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-22f095a4-597c-4c65-acc2-d9ef6b46fb22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:47.606161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22f095a4-597c-4c65-acc2-d9ef6b46fb22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:47.606670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22f095a4-597c-4c65-acc2-d9ef6b46fb22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:47.607533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22f095a4-597c-4c65-acc2-d9ef6b46fb22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:47.608031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22f095a4-597c-4c65-acc2-d9ef6b46fb22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:47.776329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ca270514-6857-4577-97af-a9c3ab7d846e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 22070 microversion: 2.20 time: 3.835803 Apr 19 03:40:47.781109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 198/430] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:43 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 22070 bytes in 3839 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:40:47.852763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-22f095a4-597c-4c65-acc2-d9ef6b46fb22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:47.862549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-22f095a4-597c-4c65-acc2-d9ef6b46fb22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.269052 Apr 19 03:40:47.863200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 233/431] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:47 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:47.886756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-42117973-b517-4fe7-9101-fe53153f29aa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:47.887581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-42117973-b517-4fe7-9101-fe53153f29aa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:47.896074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42117973-b517-4fe7-9101-fe53153f29aa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:47.896571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42117973-b517-4fe7-9101-fe53153f29aa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:47.897400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42117973-b517-4fe7-9101-fe53153f29aa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:47.897887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42117973-b517-4fe7-9101-fe53153f29aa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:48.139609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-42117973-b517-4fe7-9101-fe53153f29aa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:48.149092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-42117973-b517-4fe7-9101-fe53153f29aa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.267682 Apr 19 03:40:48.149706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 199/432] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:47 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:48.789839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-825abea3-1905-46ae-9ec9-613630e4bc0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:48.791531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-825abea3-1905-46ae-9ec9-613630e4bc0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:48.800716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-825abea3-1905-46ae-9ec9-613630e4bc0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:48.801221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-825abea3-1905-46ae-9ec9-613630e4bc0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:48.802038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-825abea3-1905-46ae-9ec9-613630e4bc0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:48.803408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-825abea3-1905-46ae-9ec9-613630e4bc0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:48.881846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fb42179b-7ccb-4249-b064-17419821645a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:48.882743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fb42179b-7ccb-4249-b064-17419821645a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:48.896825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb42179b-7ccb-4249-b064-17419821645a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:48.901839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb42179b-7ccb-4249-b064-17419821645a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:48.902751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb42179b-7ccb-4249-b064-17419821645a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:48.903302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb42179b-7ccb-4249-b064-17419821645a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:48.969509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-825abea3-1905-46ae-9ec9-613630e4bc0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 23803 microversion: 2.20 time: 0.183559 Apr 19 03:40:48.974098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 234/433] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:48 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 23803 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:40:49.059647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ef7a92ce-f529-423b-9cec-6ae02b5e6e48 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67da9c96-9a99-4f7e-b2a7-d83539b91a37"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:49.060961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ef7a92ce-f529-423b-9cec-6ae02b5e6e48 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:49.074176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef7a92ce-f529-423b-9cec-6ae02b5e6e48 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:49.074685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef7a92ce-f529-423b-9cec-6ae02b5e6e48 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:49.075584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef7a92ce-f529-423b-9cec-6ae02b5e6e48 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:49.076083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef7a92ce-f529-423b-9cec-6ae02b5e6e48 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:49.181566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fb42179b-7ccb-4249-b064-17419821645a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:49.192127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fb42179b-7ccb-4249-b064-17419821645a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.314226 Apr 19 03:40:49.192896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 200/434] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:48 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:49.200813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-253b4c3f-70ff-45be-8ebc-c1b81b8e2557 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:49.201476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-253b4c3f-70ff-45be-8ebc-c1b81b8e2557 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:49.210132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-253b4c3f-70ff-45be-8ebc-c1b81b8e2557 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:49.210690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-253b4c3f-70ff-45be-8ebc-c1b81b8e2557 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:49.211627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-253b4c3f-70ff-45be-8ebc-c1b81b8e2557 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:49.212535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-253b4c3f-70ff-45be-8ebc-c1b81b8e2557 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:49.486930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-253b4c3f-70ff-45be-8ebc-c1b81b8e2557 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:49.500739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-253b4c3f-70ff-45be-8ebc-c1b81b8e2557 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.306506 Apr 19 03:40:49.501603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 201/435] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:49 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:49.983734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0abb6a97-2cb2-4930-91ed-eb09dfbc5da5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:49.984983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0abb6a97-2cb2-4930-91ed-eb09dfbc5da5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:50.000954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0abb6a97-2cb2-4930-91ed-eb09dfbc5da5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:50.001785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0abb6a97-2cb2-4930-91ed-eb09dfbc5da5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:50.003289 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0abb6a97-2cb2-4930-91ed-eb09dfbc5da5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:50.003988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0abb6a97-2cb2-4930-91ed-eb09dfbc5da5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:50.047529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ef7a92ce-f529-423b-9cec-6ae02b5e6e48 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "POST /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.992573 Apr 19 03:40:50.048390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 235/436] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:40:49 2021] POST /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f/os-volume_attachments => generated 194 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:40:50.210987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e1e75935-7839-4834-8e6d-f6004eff524c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:50.211782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e1e75935-7839-4834-8e6d-f6004eff524c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:50.220397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1e75935-7839-4834-8e6d-f6004eff524c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:50.220899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1e75935-7839-4834-8e6d-f6004eff524c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:50.221733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1e75935-7839-4834-8e6d-f6004eff524c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:50.222221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1e75935-7839-4834-8e6d-f6004eff524c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:50.436854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e1e75935-7839-4834-8e6d-f6004eff524c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:50.446391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e1e75935-7839-4834-8e6d-f6004eff524c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.240042 Apr 19 03:40:50.447015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 236/437] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:50 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:50.520841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6dba37fc-1322-4a75-bccc-a0dbf91f8b5f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:50.521446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6dba37fc-1322-4a75-bccc-a0dbf91f8b5f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:50.529401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6dba37fc-1322-4a75-bccc-a0dbf91f8b5f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:50.529914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6dba37fc-1322-4a75-bccc-a0dbf91f8b5f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:50.530744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6dba37fc-1322-4a75-bccc-a0dbf91f8b5f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:50.531267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6dba37fc-1322-4a75-bccc-a0dbf91f8b5f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:50.744772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6dba37fc-1322-4a75-bccc-a0dbf91f8b5f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:50.754138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6dba37fc-1322-4a75-bccc-a0dbf91f8b5f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.237073 Apr 19 03:40:50.754808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 237/438] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:50 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:51.464568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a38c2151-6119-4876-b70d-be4cb18062fd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:51.465166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a38c2151-6119-4876-b70d-be4cb18062fd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:51.472909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a38c2151-6119-4876-b70d-be4cb18062fd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:51.473409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a38c2151-6119-4876-b70d-be4cb18062fd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:51.474239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a38c2151-6119-4876-b70d-be4cb18062fd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:51.474718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a38c2151-6119-4876-b70d-be4cb18062fd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:51.682612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a38c2151-6119-4876-b70d-be4cb18062fd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:51.692013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a38c2151-6119-4876-b70d-be4cb18062fd tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.231747 Apr 19 03:40:51.692634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 238/439] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:51 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:51.771635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-586c1d1e-1e36-4c60-b01b-2c406943e3a5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:51.772288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-586c1d1e-1e36-4c60-b01b-2c406943e3a5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:51.780025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-586c1d1e-1e36-4c60-b01b-2c406943e3a5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:51.780530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-586c1d1e-1e36-4c60-b01b-2c406943e3a5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:51.781355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-586c1d1e-1e36-4c60-b01b-2c406943e3a5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:51.781840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-586c1d1e-1e36-4c60-b01b-2c406943e3a5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:51.999589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-586c1d1e-1e36-4c60-b01b-2c406943e3a5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:52.009154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-586c1d1e-1e36-4c60-b01b-2c406943e3a5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.241443 Apr 19 03:40:52.009776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 239/440] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:51 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:52.709182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-64a4e0aa-41a9-4110-b7b0-e9f92e0ad720 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:52.709850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-64a4e0aa-41a9-4110-b7b0-e9f92e0ad720 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:52.718679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64a4e0aa-41a9-4110-b7b0-e9f92e0ad720 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:52.719226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64a4e0aa-41a9-4110-b7b0-e9f92e0ad720 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:52.720052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64a4e0aa-41a9-4110-b7b0-e9f92e0ad720 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:52.720533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64a4e0aa-41a9-4110-b7b0-e9f92e0ad720 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:53.077397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0abb6a97-2cb2-4930-91ed-eb09dfbc5da5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 27458 microversion: 2.20 time: 3.095391 Apr 19 03:40:53.078167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 202/441] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:49 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 27458 bytes in 3101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:40:53.083841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5e35af4f-df73-4222-ba29-0b44d8464108 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:53.084628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5e35af4f-df73-4222-ba29-0b44d8464108 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:53.088449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-64a4e0aa-41a9-4110-b7b0-e9f92e0ad720 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:53.100537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-64a4e0aa-41a9-4110-b7b0-e9f92e0ad720 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.395311 Apr 19 03:40:53.101185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 240/442] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:52 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:53.115869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e35af4f-df73-4222-ba29-0b44d8464108 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:53.116350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e35af4f-df73-4222-ba29-0b44d8464108 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:53.117214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e35af4f-df73-4222-ba29-0b44d8464108 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:53.117702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e35af4f-df73-4222-ba29-0b44d8464108 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:53.340593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5e35af4f-df73-4222-ba29-0b44d8464108 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:53.350346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5e35af4f-df73-4222-ba29-0b44d8464108 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.270956 Apr 19 03:40:53.351026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 203/443] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:53 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:54.094184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0c467a5a-3025-4da2-b64d-f295983a5ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:54.096281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0c467a5a-3025-4da2-b64d-f295983a5ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:54.107970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c467a5a-3025-4da2-b64d-f295983a5ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:54.108938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c467a5a-3025-4da2-b64d-f295983a5ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:54.110003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c467a5a-3025-4da2-b64d-f295983a5ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:54.111522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c467a5a-3025-4da2-b64d-f295983a5ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:54.118333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-883f8e79-252d-4364-8c48-78916224887b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:54.119325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-883f8e79-252d-4364-8c48-78916224887b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:54.128355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-883f8e79-252d-4364-8c48-78916224887b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:54.129135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-883f8e79-252d-4364-8c48-78916224887b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:54.130230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-883f8e79-252d-4364-8c48-78916224887b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:54.130791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-883f8e79-252d-4364-8c48-78916224887b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:54.362094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-883f8e79-252d-4364-8c48-78916224887b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:54.373335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-883f8e79-252d-4364-8c48-78916224887b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.259144 Apr 19 03:40:54.383215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 204/444] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:54 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:54.383215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-98f14d21-2f10-4803-84de-c54a8cd9925e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:54.383215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-98f14d21-2f10-4803-84de-c54a8cd9925e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:54.388663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98f14d21-2f10-4803-84de-c54a8cd9925e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:54.389178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98f14d21-2f10-4803-84de-c54a8cd9925e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:54.390181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98f14d21-2f10-4803-84de-c54a8cd9925e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:54.390677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98f14d21-2f10-4803-84de-c54a8cd9925e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:54.673230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-98f14d21-2f10-4803-84de-c54a8cd9925e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:54.683876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-98f14d21-2f10-4803-84de-c54a8cd9925e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.308408 Apr 19 03:40:54.684603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 205/445] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:54 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:55.395568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0aa41ec9-8352-43c5-9ca7-5d1dde13c114 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:55.396211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0aa41ec9-8352-43c5-9ca7-5d1dde13c114 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:55.404614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0aa41ec9-8352-43c5-9ca7-5d1dde13c114 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:55.405110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0aa41ec9-8352-43c5-9ca7-5d1dde13c114 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:55.405932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0aa41ec9-8352-43c5-9ca7-5d1dde13c114 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:55.407173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0aa41ec9-8352-43c5-9ca7-5d1dde13c114 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:55.693521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0aa41ec9-8352-43c5-9ca7-5d1dde13c114 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:55.706151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0aa41ec9-8352-43c5-9ca7-5d1dde13c114 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.314635 Apr 19 03:40:55.706791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 206/446] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:55 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:55.711531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e5dc9b8e-99dd-4e22-82cf-510f2467811f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:55.712193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e5dc9b8e-99dd-4e22-82cf-510f2467811f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:55.722895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5dc9b8e-99dd-4e22-82cf-510f2467811f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:55.723444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5dc9b8e-99dd-4e22-82cf-510f2467811f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:55.724287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5dc9b8e-99dd-4e22-82cf-510f2467811f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:55.724786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5dc9b8e-99dd-4e22-82cf-510f2467811f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:55.948957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e5dc9b8e-99dd-4e22-82cf-510f2467811f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:55.959124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e5dc9b8e-99dd-4e22-82cf-510f2467811f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.251217 Apr 19 03:40:55.960099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 207/447] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:55 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:56.725345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d8ef0ae7-7ed3-456f-b721-bafc5519537d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:56.726733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d8ef0ae7-7ed3-456f-b721-bafc5519537d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:56.738692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8ef0ae7-7ed3-456f-b721-bafc5519537d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:56.740683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8ef0ae7-7ed3-456f-b721-bafc5519537d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:56.741778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8ef0ae7-7ed3-456f-b721-bafc5519537d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:56.742475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8ef0ae7-7ed3-456f-b721-bafc5519537d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:56.976697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d8ef0ae7-7ed3-456f-b721-bafc5519537d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:56.987178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d8ef0ae7-7ed3-456f-b721-bafc5519537d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.266348 Apr 19 03:40:56.988006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 208/448] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:56 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:56.993145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-34337d58-3797-41e6-8f98-0c71ef35cce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:56.993838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-34337d58-3797-41e6-8f98-0c71ef35cce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:57.002322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34337d58-3797-41e6-8f98-0c71ef35cce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:57.002828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34337d58-3797-41e6-8f98-0c71ef35cce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:57.003698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34337d58-3797-41e6-8f98-0c71ef35cce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:57.004193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34337d58-3797-41e6-8f98-0c71ef35cce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:57.212122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0c467a5a-3025-4da2-b64d-f295983a5ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 27872 microversion: 2.20 time: 3.124970 Apr 19 03:40:57.213832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 241/449] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:54 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 27872 bytes in 3128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:40:57.253094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-34337d58-3797-41e6-8f98-0c71ef35cce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:57.262893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-34337d58-3797-41e6-8f98-0c71ef35cce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.273804 Apr 19 03:40:57.263559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 209/450] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:56 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:58.006504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-83de56c2-c56e-40bc-bc79-49f826945e60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:58.008262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-83de56c2-c56e-40bc-bc79-49f826945e60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:58.017673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83de56c2-c56e-40bc-bc79-49f826945e60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:58.018572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83de56c2-c56e-40bc-bc79-49f826945e60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:58.019705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83de56c2-c56e-40bc-bc79-49f826945e60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:58.020334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83de56c2-c56e-40bc-bc79-49f826945e60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:58.225443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7e50c924-6ccf-434b-98e4-89d686f0240e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:40:58.226501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7e50c924-6ccf-434b-98e4-89d686f0240e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:58.235197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e50c924-6ccf-434b-98e4-89d686f0240e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:58.235714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e50c924-6ccf-434b-98e4-89d686f0240e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:58.236960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e50c924-6ccf-434b-98e4-89d686f0240e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:58.237389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e50c924-6ccf-434b-98e4-89d686f0240e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:58.255323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-83de56c2-c56e-40bc-bc79-49f826945e60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:58.265452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-83de56c2-c56e-40bc-bc79-49f826945e60 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.263748 Apr 19 03:40:58.266084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 242/451] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:58 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:58.282137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2dc94f1e-91ff-4a76-9415-6a6ebc2953ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:58.283172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2dc94f1e-91ff-4a76-9415-6a6ebc2953ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:58.291990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dc94f1e-91ff-4a76-9415-6a6ebc2953ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:58.292806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dc94f1e-91ff-4a76-9415-6a6ebc2953ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:58.293974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dc94f1e-91ff-4a76-9415-6a6ebc2953ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:58.294668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dc94f1e-91ff-4a76-9415-6a6ebc2953ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:58.551739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2dc94f1e-91ff-4a76-9415-6a6ebc2953ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:58.568080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2dc94f1e-91ff-4a76-9415-6a6ebc2953ab tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.287928 Apr 19 03:40:58.570005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 243/452] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:58 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:40:59.285300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b00f1cb5-d10c-4149-9723-c142d506f85f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:59.286247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b00f1cb5-d10c-4149-9723-c142d506f85f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:59.295893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b00f1cb5-d10c-4149-9723-c142d506f85f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:59.296414 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b00f1cb5-d10c-4149-9723-c142d506f85f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:59.297429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b00f1cb5-d10c-4149-9723-c142d506f85f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:59.297916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b00f1cb5-d10c-4149-9723-c142d506f85f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:59.525788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b00f1cb5-d10c-4149-9723-c142d506f85f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:59.538597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b00f1cb5-d10c-4149-9723-c142d506f85f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.257578 Apr 19 03:40:59.554415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 244/453] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:59 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:40:59.590429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1d1aefa4-9a34-416b-8d90-dbbad915414c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:40:59.591186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1d1aefa4-9a34-416b-8d90-dbbad915414c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:40:59.606273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d1aefa4-9a34-416b-8d90-dbbad915414c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:59.612896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d1aefa4-9a34-416b-8d90-dbbad915414c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:59.612896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d1aefa4-9a34-416b-8d90-dbbad915414c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:40:59.612896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d1aefa4-9a34-416b-8d90-dbbad915414c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:40:59.850901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1d1aefa4-9a34-416b-8d90-dbbad915414c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:40:59.862954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1d1aefa4-9a34-416b-8d90-dbbad915414c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.277254 Apr 19 03:40:59.863742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 245/454] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:40:59 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:41:00.559929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fe7b1840-fbb3-4a3a-91a3-f08d3b205f75 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:00.560603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fe7b1840-fbb3-4a3a-91a3-f08d3b205f75 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:00.568481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe7b1840-fbb3-4a3a-91a3-f08d3b205f75 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:00.568936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe7b1840-fbb3-4a3a-91a3-f08d3b205f75 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:00.569805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe7b1840-fbb3-4a3a-91a3-f08d3b205f75 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:00.570301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe7b1840-fbb3-4a3a-91a3-f08d3b205f75 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:00.787354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fe7b1840-fbb3-4a3a-91a3-f08d3b205f75 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:00.797151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fe7b1840-fbb3-4a3a-91a3-f08d3b205f75 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.241908 Apr 19 03:41:00.797760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 246/455] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:00 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:41:00.882354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4f013f1b-33ae-48b6-aa49-69fe873ab6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:00.882951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4f013f1b-33ae-48b6-aa49-69fe873ab6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:00.890433 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f013f1b-33ae-48b6-aa49-69fe873ab6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:00.890948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f013f1b-33ae-48b6-aa49-69fe873ab6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:00.891799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f013f1b-33ae-48b6-aa49-69fe873ab6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:00.892293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f013f1b-33ae-48b6-aa49-69fe873ab6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:00.953824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7e50c924-6ccf-434b-98e4-89d686f0240e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28049 microversion: 2.20 time: 2.732552 Apr 19 03:41:00.954517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 210/456] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:40:58 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28049 bytes in 2734 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:01.101135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4f013f1b-33ae-48b6-aa49-69fe873ab6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:01.111374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4f013f1b-33ae-48b6-aa49-69fe873ab6b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1722 microversion: 2.1 time: 0.232581 Apr 19 03:41:01.111992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 247/457] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:00 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:41:01.816539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b9835a46-208f-4046-8aca-1ba2ac75b569 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:01.817315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b9835a46-208f-4046-8aca-1ba2ac75b569 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:01.826663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9835a46-208f-4046-8aca-1ba2ac75b569 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:01.827195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9835a46-208f-4046-8aca-1ba2ac75b569 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:01.828029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9835a46-208f-4046-8aca-1ba2ac75b569 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:01.828513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9835a46-208f-4046-8aca-1ba2ac75b569 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:01.966658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d691d0eb-c496-4697-8e0a-2372d427e1f7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:01.968043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d691d0eb-c496-4697-8e0a-2372d427e1f7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:01.976383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d691d0eb-c496-4697-8e0a-2372d427e1f7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:01.976898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d691d0eb-c496-4697-8e0a-2372d427e1f7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:01.977746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d691d0eb-c496-4697-8e0a-2372d427e1f7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:01.978286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d691d0eb-c496-4697-8e0a-2372d427e1f7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:02.037624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b9835a46-208f-4046-8aca-1ba2ac75b569 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:02.047999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b9835a46-208f-4046-8aca-1ba2ac75b569 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.235916 Apr 19 03:41:02.048624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 211/458] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:01 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:02.088661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d691d0eb-c496-4697-8e0a-2372d427e1f7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28232 microversion: 2.20 time: 0.126045 Apr 19 03:41:02.089352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 248/459] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:01 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28232 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:41:02.129259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cfdcef54-70cb-43ab-b2bd-3b29592e1ee1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:02.129864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cfdcef54-70cb-43ab-b2bd-3b29592e1ee1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:02.138202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cfdcef54-70cb-43ab-b2bd-3b29592e1ee1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:02.138702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cfdcef54-70cb-43ab-b2bd-3b29592e1ee1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:02.139547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cfdcef54-70cb-43ab-b2bd-3b29592e1ee1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:02.140032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cfdcef54-70cb-43ab-b2bd-3b29592e1ee1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:02.351173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cfdcef54-70cb-43ab-b2bd-3b29592e1ee1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:02.361441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cfdcef54-70cb-43ab-b2bd-3b29592e1ee1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1699 microversion: 2.1 time: 0.235898 Apr 19 03:41:02.362210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 212/460] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:02 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1699 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:02.379959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-98ca3c56-54e8-44f0-9bf1-7f1167a1f519 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:02.388393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98ca3c56-54e8-44f0-9bf1-7f1167a1f519 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:02.388890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98ca3c56-54e8-44f0-9bf1-7f1167a1f519 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:02.448593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-98ca3c56-54e8-44f0-9bf1-7f1167a1f519 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Going to try to start instance {{(pid=100591) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 19 03:41:02.588569 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-98ca3c56-54e8-44f0-9bf1-7f1167a1f519 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 202 len: 0 microversion: 2.1 time: 0.212185 Apr 19 03:41:02.589557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 249/461] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:41:02 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:02.607442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0aa8d317-5e3b-4a09-9534-b16f92ef8aa6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:02.608160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0aa8d317-5e3b-4a09-9534-b16f92ef8aa6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:02.616457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0aa8d317-5e3b-4a09-9534-b16f92ef8aa6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:02.616938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0aa8d317-5e3b-4a09-9534-b16f92ef8aa6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:02.617772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0aa8d317-5e3b-4a09-9534-b16f92ef8aa6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:02.618261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0aa8d317-5e3b-4a09-9534-b16f92ef8aa6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:02.939533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0aa8d317-5e3b-4a09-9534-b16f92ef8aa6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:02.949850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0aa8d317-5e3b-4a09-9534-b16f92ef8aa6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1708 microversion: 2.1 time: 0.355706 Apr 19 03:41:02.950476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 213/462] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:02 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1708 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:03.067005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-af0199dc-cce3-459a-b203-8d20960a7366 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:03.068201 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-af0199dc-cce3-459a-b203-8d20960a7366 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:03.077778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af0199dc-cce3-459a-b203-8d20960a7366 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:03.079438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af0199dc-cce3-459a-b203-8d20960a7366 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:03.089638 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af0199dc-cce3-459a-b203-8d20960a7366 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:03.090736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af0199dc-cce3-459a-b203-8d20960a7366 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:03.101052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-32081ec0-d51b-42ee-be16-751b621d7e38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:03.102252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-32081ec0-d51b-42ee-be16-751b621d7e38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:03.115911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-32081ec0-d51b-42ee-be16-751b621d7e38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:03.116797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-32081ec0-d51b-42ee-be16-751b621d7e38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:03.117226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-32081ec0-d51b-42ee-be16-751b621d7e38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:03.117899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-32081ec0-d51b-42ee-be16-751b621d7e38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:03.441730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-32081ec0-d51b-42ee-be16-751b621d7e38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28232 microversion: 2.20 time: 0.340270 Apr 19 03:41:03.441730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 214/463] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:03 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28232 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:03.457547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-af0199dc-cce3-459a-b203-8d20960a7366 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:03.469174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-af0199dc-cce3-459a-b203-8d20960a7366 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.406804 Apr 19 03:41:03.470051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 250/464] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:03 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:03.970132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-43d58b4c-d3c3-47ba-86ed-193acc5f9413 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:03.971031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-43d58b4c-d3c3-47ba-86ed-193acc5f9413 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:03.980800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-43d58b4c-d3c3-47ba-86ed-193acc5f9413 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:03.981565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-43d58b4c-d3c3-47ba-86ed-193acc5f9413 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:03.982747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-43d58b4c-d3c3-47ba-86ed-193acc5f9413 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:03.983509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-43d58b4c-d3c3-47ba-86ed-193acc5f9413 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:04.214657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-43d58b4c-d3c3-47ba-86ed-193acc5f9413 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:04.224152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-43d58b4c-d3c3-47ba-86ed-193acc5f9413 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1708 microversion: 2.1 time: 0.259405 Apr 19 03:41:04.224841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 215/465] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:03 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1708 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:04.450160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-47732a6e-ef46-4d1a-ad89-25402b13bc48 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:04.451228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-47732a6e-ef46-4d1a-ad89-25402b13bc48 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:04.459360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47732a6e-ef46-4d1a-ad89-25402b13bc48 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:04.459869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47732a6e-ef46-4d1a-ad89-25402b13bc48 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:04.460702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47732a6e-ef46-4d1a-ad89-25402b13bc48 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:04.461193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47732a6e-ef46-4d1a-ad89-25402b13bc48 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:04.488358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b2ecf3ff-42ff-465b-9f8f-3afa56b11d5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:04.489160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b2ecf3ff-42ff-465b-9f8f-3afa56b11d5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:04.497300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2ecf3ff-42ff-465b-9f8f-3afa56b11d5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:04.503319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2ecf3ff-42ff-465b-9f8f-3afa56b11d5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:04.503319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2ecf3ff-42ff-465b-9f8f-3afa56b11d5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:04.503319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2ecf3ff-42ff-465b-9f8f-3afa56b11d5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:04.590732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-47732a6e-ef46-4d1a-ad89-25402b13bc48 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28232 microversion: 2.20 time: 0.143882 Apr 19 03:41:04.591653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 251/466] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:04 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28232 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:04.772690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b2ecf3ff-42ff-465b-9f8f-3afa56b11d5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:04.792279 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b2ecf3ff-42ff-465b-9f8f-3afa56b11d5f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.308271 Apr 19 03:41:04.792914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 216/467] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:04 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:05.244783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-83f4d05a-f0b8-40ea-907c-72ed2e66ce05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:05.245617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-83f4d05a-f0b8-40ea-907c-72ed2e66ce05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:05.254312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83f4d05a-f0b8-40ea-907c-72ed2e66ce05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:05.254862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83f4d05a-f0b8-40ea-907c-72ed2e66ce05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:05.255725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83f4d05a-f0b8-40ea-907c-72ed2e66ce05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:05.256222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-83f4d05a-f0b8-40ea-907c-72ed2e66ce05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:05.471834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-83f4d05a-f0b8-40ea-907c-72ed2e66ce05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:05.481943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-83f4d05a-f0b8-40ea-907c-72ed2e66ce05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1712 microversion: 2.1 time: 0.242530 Apr 19 03:41:05.482626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 252/468] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:05 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1712 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:05.604325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-745f677d-025f-4376-8e22-bc03d0b5b78d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:05.605418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-745f677d-025f-4376-8e22-bc03d0b5b78d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:05.614167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-745f677d-025f-4376-8e22-bc03d0b5b78d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:05.614672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-745f677d-025f-4376-8e22-bc03d0b5b78d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:05.615529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-745f677d-025f-4376-8e22-bc03d0b5b78d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:05.616020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-745f677d-025f-4376-8e22-bc03d0b5b78d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:05.752897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-745f677d-025f-4376-8e22-bc03d0b5b78d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28232 microversion: 2.20 time: 0.153175 Apr 19 03:41:05.757085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 217/469] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:05 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28232 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:05.810107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-db4712fe-e9a6-46e0-9261-eb90e7210205 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:05.810782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-db4712fe-e9a6-46e0-9261-eb90e7210205 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:05.818567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db4712fe-e9a6-46e0-9261-eb90e7210205 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:05.819075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db4712fe-e9a6-46e0-9261-eb90e7210205 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:05.819940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db4712fe-e9a6-46e0-9261-eb90e7210205 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:05.820443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db4712fe-e9a6-46e0-9261-eb90e7210205 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:06.065892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-db4712fe-e9a6-46e0-9261-eb90e7210205 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:06.079867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-db4712fe-e9a6-46e0-9261-eb90e7210205 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1567 microversion: 2.1 time: 0.273834 Apr 19 03:41:06.080510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 253/470] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:05 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:06.766058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d6b6a24a-b2ec-42ae-b2eb-48c675200ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:06.767459 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d6b6a24a-b2ec-42ae-b2eb-48c675200ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:06.776172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6b6a24a-b2ec-42ae-b2eb-48c675200ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:06.776759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6b6a24a-b2ec-42ae-b2eb-48c675200ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:06.777705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6b6a24a-b2ec-42ae-b2eb-48c675200ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:06.778302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6b6a24a-b2ec-42ae-b2eb-48c675200ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:06.906316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d6b6a24a-b2ec-42ae-b2eb-48c675200ef5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28357 microversion: 2.20 time: 0.144715 Apr 19 03:41:06.910944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 218/471] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:06 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:07.098691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-945a90d0-96c2-4d66-8ef7-18497c129c36 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:07.099328 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-945a90d0-96c2-4d66-8ef7-18497c129c36 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:07.108252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-945a90d0-96c2-4d66-8ef7-18497c129c36 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:07.108760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-945a90d0-96c2-4d66-8ef7-18497c129c36 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:07.109591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-945a90d0-96c2-4d66-8ef7-18497c129c36 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:07.110079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-945a90d0-96c2-4d66-8ef7-18497c129c36 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:07.607658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-945a90d0-96c2-4d66-8ef7-18497c129c36 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:07.622590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-945a90d0-96c2-4d66-8ef7-18497c129c36 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1547 microversion: 2.1 time: 0.523730 Apr 19 03:41:07.622590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 254/472] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:07 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1547 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:07.638509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8608f44c-8553-4204-b6bb-d6fa446d3e1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:07.639168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8608f44c-8553-4204-b6bb-d6fa446d3e1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:07.647690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8608f44c-8553-4204-b6bb-d6fa446d3e1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:07.648194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8608f44c-8553-4204-b6bb-d6fa446d3e1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:07.649013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8608f44c-8553-4204-b6bb-d6fa446d3e1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:07.649495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8608f44c-8553-4204-b6bb-d6fa446d3e1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:07.825956 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-8608f44c-8553-4204-b6bb-d6fa446d3e1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] HTTP exception thrown: Cannot 'detach_volume' instance 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 while it is in vm_state rescued Apr 19 03:41:07.826618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8608f44c-8553-4204-b6bb-d6fa446d3e1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Returning 409 to user: Cannot 'detach_volume' instance 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 while it is in vm_state rescued {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:07.827540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8608f44c-8553-4204-b6bb-d6fa446d3e1c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/os-volume_attachments/f890e8bd-42c0-4fdd-9abb-393eee851536" status: 409 len: 152 microversion: 2.1 time: 0.194291 Apr 19 03:41:07.828134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 219/473] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:41:07 2021] DELETE /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/os-volume_attachments/f890e8bd-42c0-4fdd-9abb-393eee851536 => generated 152 bytes in 196 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 19 03:41:07.837293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4d7833a7-a6fb-4ab8-9954-9b0972aaa79c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:07.837890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4d7833a7-a6fb-4ab8-9954-9b0972aaa79c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:07.846087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d7833a7-a6fb-4ab8-9954-9b0972aaa79c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:07.846603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d7833a7-a6fb-4ab8-9954-9b0972aaa79c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:07.847471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d7833a7-a6fb-4ab8-9954-9b0972aaa79c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:07.847968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d7833a7-a6fb-4ab8-9954-9b0972aaa79c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:07.918346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-47a0b72f-bfed-49a8-8725-276ba30613f4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:07.919549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-47a0b72f-bfed-49a8-8725-276ba30613f4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:07.931522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47a0b72f-bfed-49a8-8725-276ba30613f4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:07.932024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47a0b72f-bfed-49a8-8725-276ba30613f4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:07.932858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47a0b72f-bfed-49a8-8725-276ba30613f4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:07.933352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47a0b72f-bfed-49a8-8725-276ba30613f4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:08.063223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4d7833a7-a6fb-4ab8-9954-9b0972aaa79c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/action" status: 202 len: 0 microversion: 2.1 time: 0.229847 Apr 19 03:41:08.063930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 255/474] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:41:07 2021] POST /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:08.073425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-84726b39-8adc-471b-a723-b28fad23894e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:08.074193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-84726b39-8adc-471b-a723-b28fad23894e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:08.082143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84726b39-8adc-471b-a723-b28fad23894e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:08.082647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84726b39-8adc-471b-a723-b28fad23894e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:08.083628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84726b39-8adc-471b-a723-b28fad23894e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:08.084094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84726b39-8adc-471b-a723-b28fad23894e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:08.305760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-84726b39-8adc-471b-a723-b28fad23894e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:08.315779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-84726b39-8adc-471b-a723-b28fad23894e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1555 microversion: 2.1 time: 0.247240 Apr 19 03:41:08.316401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 256/475] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:08 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1555 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:09.334666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dbb6a6ed-7ed0-4bef-ba27-ddd64f1fb6a3 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:09.335359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dbb6a6ed-7ed0-4bef-ba27-ddd64f1fb6a3 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:09.343796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbb6a6ed-7ed0-4bef-ba27-ddd64f1fb6a3 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:09.344292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbb6a6ed-7ed0-4bef-ba27-ddd64f1fb6a3 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:09.345113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbb6a6ed-7ed0-4bef-ba27-ddd64f1fb6a3 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:09.345598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbb6a6ed-7ed0-4bef-ba27-ddd64f1fb6a3 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:09.561102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dbb6a6ed-7ed0-4bef-ba27-ddd64f1fb6a3 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:09.570773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dbb6a6ed-7ed0-4bef-ba27-ddd64f1fb6a3 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1555 microversion: 2.1 time: 0.240710 Apr 19 03:41:09.572183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 257/476] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:09 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:41:10.294907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-47a0b72f-bfed-49a8-8725-276ba30613f4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28523 microversion: 2.20 time: 2.380365 Apr 19 03:41:10.295616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 220/477] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:07 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28523 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:10.590597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-778fa331-1a45-41f9-8049-9df22ef2aff1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:10.591839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-778fa331-1a45-41f9-8049-9df22ef2aff1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:10.599944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-778fa331-1a45-41f9-8049-9df22ef2aff1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:10.600838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-778fa331-1a45-41f9-8049-9df22ef2aff1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:10.601980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-778fa331-1a45-41f9-8049-9df22ef2aff1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:10.602548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-778fa331-1a45-41f9-8049-9df22ef2aff1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:10.846805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-778fa331-1a45-41f9-8049-9df22ef2aff1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:10.857749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-778fa331-1a45-41f9-8049-9df22ef2aff1 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1555 microversion: 2.1 time: 0.271759 Apr 19 03:41:10.859504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 258/478] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:10 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:11.310583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bd3cb0d7-943e-4d48-ba2c-8a8bfe3bbb69 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:11.312031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bd3cb0d7-943e-4d48-ba2c-8a8bfe3bbb69 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:11.321766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd3cb0d7-943e-4d48-ba2c-8a8bfe3bbb69 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:11.322273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd3cb0d7-943e-4d48-ba2c-8a8bfe3bbb69 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:11.323294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd3cb0d7-943e-4d48-ba2c-8a8bfe3bbb69 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:11.324074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd3cb0d7-943e-4d48-ba2c-8a8bfe3bbb69 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:11.457705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bd3cb0d7-943e-4d48-ba2c-8a8bfe3bbb69 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28523 microversion: 2.20 time: 0.153880 Apr 19 03:41:11.459511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 221/479] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:11 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:11.875854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d7bcb93e-2bb8-4388-b0d6-fa8be7ed503c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:11.876498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d7bcb93e-2bb8-4388-b0d6-fa8be7ed503c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:11.892639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7bcb93e-2bb8-4388-b0d6-fa8be7ed503c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:11.893425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7bcb93e-2bb8-4388-b0d6-fa8be7ed503c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:11.894245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7bcb93e-2bb8-4388-b0d6-fa8be7ed503c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:11.894919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7bcb93e-2bb8-4388-b0d6-fa8be7ed503c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:12.422941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d7bcb93e-2bb8-4388-b0d6-fa8be7ed503c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:12.438149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d7bcb93e-2bb8-4388-b0d6-fa8be7ed503c tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1555 microversion: 2.1 time: 0.566133 Apr 19 03:41:12.448148 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 259/480] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:11 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1555 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:12.481881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-52743819-4069-4803-89b6-9c6c122e20ec tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:12.483251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-52743819-4069-4803-89b6-9c6c122e20ec tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:12.502957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52743819-4069-4803-89b6-9c6c122e20ec tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:12.505601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52743819-4069-4803-89b6-9c6c122e20ec tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:12.511019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52743819-4069-4803-89b6-9c6c122e20ec tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:12.511718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52743819-4069-4803-89b6-9c6c122e20ec tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:12.680611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-52743819-4069-4803-89b6-9c6c122e20ec tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28690 microversion: 2.20 time: 0.213701 Apr 19 03:41:12.681856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 222/481] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:12 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28690 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:12.756670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2c82158c-ec9f-430f-b750-bad5112c457c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:12.757322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2c82158c-ec9f-430f-b750-bad5112c457c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:12.766721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c82158c-ec9f-430f-b750-bad5112c457c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:12.767408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c82158c-ec9f-430f-b750-bad5112c457c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:12.768451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c82158c-ec9f-430f-b750-bad5112c457c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:12.769053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c82158c-ec9f-430f-b750-bad5112c457c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:12.986825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-2c82158c-ec9f-430f-b750-bad5112c457c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lazy-loading 'services' on Instance uuid fcad7e0c-ccda-4c71-a827-bcd885cd3b4f {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:41:13.316878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2c82158c-ec9f-430f-b750-bad5112c457c tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f/os-volume_attachments/67da9c96-9a99-4f7e-b2a7-d83539b91a37" status: 202 len: 0 microversion: 2.1 time: 0.564334 Apr 19 03:41:13.317801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 260/482] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:41:12 2021] DELETE /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f/os-volume_attachments/67da9c96-9a99-4f7e-b2a7-d83539b91a37 => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:13.457005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2212d1e4-5e4b-4364-a82f-917f6bec1c04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:13.458759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2212d1e4-5e4b-4364-a82f-917f6bec1c04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:13.473231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2212d1e4-5e4b-4364-a82f-917f6bec1c04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:13.473984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2212d1e4-5e4b-4364-a82f-917f6bec1c04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:13.474832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2212d1e4-5e4b-4364-a82f-917f6bec1c04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:13.475432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2212d1e4-5e4b-4364-a82f-917f6bec1c04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:13.695196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2a863f8f-002c-4d5d-bb17-b3fe847edaab tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:13.696843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2a863f8f-002c-4d5d-bb17-b3fe847edaab tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:13.711898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a863f8f-002c-4d5d-bb17-b3fe847edaab tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:13.711898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a863f8f-002c-4d5d-bb17-b3fe847edaab tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:13.713197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a863f8f-002c-4d5d-bb17-b3fe847edaab tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:13.714018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a863f8f-002c-4d5d-bb17-b3fe847edaab tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:13.757874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2212d1e4-5e4b-4364-a82f-917f6bec1c04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:13.771360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2212d1e4-5e4b-4364-a82f-917f6bec1c04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1555 microversion: 2.1 time: 0.318897 Apr 19 03:41:13.773274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 223/483] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:13 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1555 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:13.866689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2a863f8f-002c-4d5d-bb17-b3fe847edaab tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28690 microversion: 2.20 time: 0.176157 Apr 19 03:41:13.867777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 261/484] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:13 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:41:14.790833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c65e0241-1ced-416b-86a5-ba7551fc37af tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:14.791923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c65e0241-1ced-416b-86a5-ba7551fc37af tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:14.810129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c65e0241-1ced-416b-86a5-ba7551fc37af tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:14.820505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c65e0241-1ced-416b-86a5-ba7551fc37af tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:14.821451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c65e0241-1ced-416b-86a5-ba7551fc37af tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:14.825531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c65e0241-1ced-416b-86a5-ba7551fc37af tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:14.880370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5cc369f3-4a51-46ad-b787-ca1fd03924fb tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:14.881612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5cc369f3-4a51-46ad-b787-ca1fd03924fb tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:14.892674 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cc369f3-4a51-46ad-b787-ca1fd03924fb tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:14.893422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cc369f3-4a51-46ad-b787-ca1fd03924fb tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:14.894256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cc369f3-4a51-46ad-b787-ca1fd03924fb tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:14.894932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cc369f3-4a51-46ad-b787-ca1fd03924fb tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:15.056917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5cc369f3-4a51-46ad-b787-ca1fd03924fb tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28690 microversion: 2.20 time: 0.181066 Apr 19 03:41:15.061792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 262/485] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:14 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:15.190746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c65e0241-1ced-416b-86a5-ba7551fc37af tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:15.203733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c65e0241-1ced-416b-86a5-ba7551fc37af tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1561 microversion: 2.1 time: 0.417404 Apr 19 03:41:15.204599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 224/486] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:14 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1561 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:15.428078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c945ab00-228e-40fb-8a73-2b3009296332 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:15.428736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c945ab00-228e-40fb-8a73-2b3009296332 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:15.450738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c945ab00-228e-40fb-8a73-2b3009296332 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:15.451421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c945ab00-228e-40fb-8a73-2b3009296332 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:15.452390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c945ab00-228e-40fb-8a73-2b3009296332 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:15.452843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c945ab00-228e-40fb-8a73-2b3009296332 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:15.786756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-c945ab00-228e-40fb-8a73-2b3009296332 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lazy-loading 'services' on Instance uuid 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:41:16.071414 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d1b9c040-ad1c-4679-825b-14a2130e1711 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:16.072462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d1b9c040-ad1c-4679-825b-14a2130e1711 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:16.091124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1b9c040-ad1c-4679-825b-14a2130e1711 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:16.091651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1b9c040-ad1c-4679-825b-14a2130e1711 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:16.092510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1b9c040-ad1c-4679-825b-14a2130e1711 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:16.093000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1b9c040-ad1c-4679-825b-14a2130e1711 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:16.208434 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c945ab00-228e-40fb-8a73-2b3009296332 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/os-volume_attachments/f890e8bd-42c0-4fdd-9abb-393eee851536" status: 202 len: 0 microversion: 2.1 time: 0.787257 Apr 19 03:41:16.213394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 263/487] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:41:15 2021] DELETE /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22/os-volume_attachments/f890e8bd-42c0-4fdd-9abb-393eee851536 => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:16.304615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d1b9c040-ad1c-4679-825b-14a2130e1711 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28690 microversion: 2.20 time: 0.238261 Apr 19 03:41:16.309477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 225/488] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:16 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28690 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:17.318777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0abda265-e3bb-4424-8eeb-cd1a86d66ff5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:17.325531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0abda265-e3bb-4424-8eeb-cd1a86d66ff5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:17.344374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0abda265-e3bb-4424-8eeb-cd1a86d66ff5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:17.349758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0abda265-e3bb-4424-8eeb-cd1a86d66ff5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:17.350905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0abda265-e3bb-4424-8eeb-cd1a86d66ff5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:17.351885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0abda265-e3bb-4424-8eeb-cd1a86d66ff5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:17.442448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bbd1a68f-5f06-46d9-b5ea-b3e3a7501f1a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:17.443098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bbd1a68f-5f06-46d9-b5ea-b3e3a7501f1a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:17.460967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbd1a68f-5f06-46d9-b5ea-b3e3a7501f1a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:17.461483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbd1a68f-5f06-46d9-b5ea-b3e3a7501f1a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:17.462368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbd1a68f-5f06-46d9-b5ea-b3e3a7501f1a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:17.473346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbd1a68f-5f06-46d9-b5ea-b3e3a7501f1a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:17.576668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0abda265-e3bb-4424-8eeb-cd1a86d66ff5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28690 microversion: 2.20 time: 0.262595 Apr 19 03:41:17.577703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 264/489] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:17 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:17.601981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bbd1a68f-5f06-46d9-b5ea-b3e3a7501f1a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:41:17.923592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bbd1a68f-5f06-46d9-b5ea-b3e3a7501f1a tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 204 len: 0 microversion: 2.1 time: 0.485147 Apr 19 03:41:17.924949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 226/490] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:41:17 2021] DELETE /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:41:17.933893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1c566a39-b657-41ad-9b61-6346f7c42b35 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:17.934997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1c566a39-b657-41ad-9b61-6346f7c42b35 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:17.944698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c566a39-b657-41ad-9b61-6346f7c42b35 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:17.945370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c566a39-b657-41ad-9b61-6346f7c42b35 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:17.946952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c566a39-b657-41ad-9b61-6346f7c42b35 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:17.947651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c566a39-b657-41ad-9b61-6346f7c42b35 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:18.598082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4b9535e7-171e-4828-989e-4c331a55d982 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:18.599394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4b9535e7-171e-4828-989e-4c331a55d982 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:18.636361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b9535e7-171e-4828-989e-4c331a55d982 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:18.637297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b9535e7-171e-4828-989e-4c331a55d982 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:18.648878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b9535e7-171e-4828-989e-4c331a55d982 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:18.656653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1c566a39-b657-41ad-9b61-6346f7c42b35 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:18.669247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b9535e7-171e-4828-989e-4c331a55d982 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:18.689249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1c566a39-b657-41ad-9b61-6346f7c42b35 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1513 microversion: 2.1 time: 0.748183 Apr 19 03:41:18.689991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 265/491] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:17 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1513 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:18.906546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4b9535e7-171e-4828-989e-4c331a55d982 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 28997 microversion: 2.20 time: 0.320563 Apr 19 03:41:18.908295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 227/492] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:18 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 28997 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:19.708948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-035e63d7-43a6-42b5-8ce9-6f11c53bb843 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:19.710160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-035e63d7-43a6-42b5-8ce9-6f11c53bb843 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:19.720480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-035e63d7-43a6-42b5-8ce9-6f11c53bb843 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:19.721296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-035e63d7-43a6-42b5-8ce9-6f11c53bb843 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:19.722524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-035e63d7-43a6-42b5-8ce9-6f11c53bb843 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:19.729293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-035e63d7-43a6-42b5-8ce9-6f11c53bb843 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:19.920873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e62f2499-a922-42d0-9f12-fcd7fa15e35a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:19.922226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e62f2499-a922-42d0-9f12-fcd7fa15e35a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:19.942565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e62f2499-a922-42d0-9f12-fcd7fa15e35a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:19.943071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e62f2499-a922-42d0-9f12-fcd7fa15e35a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:19.943954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e62f2499-a922-42d0-9f12-fcd7fa15e35a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:19.953830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e62f2499-a922-42d0-9f12-fcd7fa15e35a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:20.158756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e62f2499-a922-42d0-9f12-fcd7fa15e35a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 30871 microversion: 2.20 time: 0.242149 Apr 19 03:41:20.162921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 228/493] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:19 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 30871 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:20.191390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-035e63d7-43a6-42b5-8ce9-6f11c53bb843 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:20.202371 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-035e63d7-43a6-42b5-8ce9-6f11c53bb843 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1513 microversion: 2.1 time: 0.498051 Apr 19 03:41:20.203014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 266/494] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:19 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1513 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:21.174118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1e8dc0c7-c342-47e3-a67c-85b6269a4bc3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:21.176111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1e8dc0c7-c342-47e3-a67c-85b6269a4bc3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:21.189990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e8dc0c7-c342-47e3-a67c-85b6269a4bc3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:21.190940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e8dc0c7-c342-47e3-a67c-85b6269a4bc3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:21.193535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e8dc0c7-c342-47e3-a67c-85b6269a4bc3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:21.194215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e8dc0c7-c342-47e3-a67c-85b6269a4bc3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:21.226891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-45dcb369-36c3-48e6-b4fd-2c2e167dcbb0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:21.228733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-45dcb369-36c3-48e6-b4fd-2c2e167dcbb0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:21.248168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45dcb369-36c3-48e6-b4fd-2c2e167dcbb0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:21.249049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45dcb369-36c3-48e6-b4fd-2c2e167dcbb0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:21.255116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45dcb369-36c3-48e6-b4fd-2c2e167dcbb0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:21.255889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45dcb369-36c3-48e6-b4fd-2c2e167dcbb0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:21.440474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1e8dc0c7-c342-47e3-a67c-85b6269a4bc3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 33794 microversion: 2.20 time: 0.272231 Apr 19 03:41:21.441297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 229/495] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:21 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 33794 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:21.790207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6f7b3d76-bd49-4953-a7c2-296d5b27db22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:21.791219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6f7b3d76-bd49-4953-a7c2-296d5b27db22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:21.801145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f7b3d76-bd49-4953-a7c2-296d5b27db22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:21.802238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f7b3d76-bd49-4953-a7c2-296d5b27db22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:21.803338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f7b3d76-bd49-4953-a7c2-296d5b27db22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:21.804073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f7b3d76-bd49-4953-a7c2-296d5b27db22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:21.897240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6f7b3d76-bd49-4953-a7c2-296d5b27db22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:41:21.976990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-45dcb369-36c3-48e6-b4fd-2c2e167dcbb0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:22.004210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-45dcb369-36c3-48e6-b4fd-2c2e167dcbb0 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1513 microversion: 2.1 time: 0.786427 Apr 19 03:41:22.004866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 267/496] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:21 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1513 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:22.168858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6f7b3d76-bd49-4953-a7c2-296d5b27db22 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 204 len: 0 microversion: 2.1 time: 0.385094 Apr 19 03:41:22.169847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 230/497] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:41:21 2021] DELETE /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 19 03:41:22.179078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-50ff1252-25f9-480a-abda-0a8944d25b33 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:22.181290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-50ff1252-25f9-480a-abda-0a8944d25b33 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:22.191431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50ff1252-25f9-480a-abda-0a8944d25b33 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:22.192277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50ff1252-25f9-480a-abda-0a8944d25b33 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:22.193337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50ff1252-25f9-480a-abda-0a8944d25b33 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:22.194256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50ff1252-25f9-480a-abda-0a8944d25b33 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:22.458746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c9c2b3e6-be88-48c3-bcd9-9cf41e2191ae tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:22.460570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c9c2b3e6-be88-48c3-bcd9-9cf41e2191ae tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:22.496632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c9c2b3e6-be88-48c3-bcd9-9cf41e2191ae tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:22.497238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c9c2b3e6-be88-48c3-bcd9-9cf41e2191ae tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:22.498213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c9c2b3e6-be88-48c3-bcd9-9cf41e2191ae tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:22.499115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c9c2b3e6-be88-48c3-bcd9-9cf41e2191ae tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:22.587990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-50ff1252-25f9-480a-abda-0a8944d25b33 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:22.597706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-50ff1252-25f9-480a-abda-0a8944d25b33 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1505 microversion: 2.1 time: 0.423434 Apr 19 03:41:22.599046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 268/498] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:22 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:22.670425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c9c2b3e6-be88-48c3-bcd9-9cf41e2191ae tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 35084 microversion: 2.20 time: 0.219188 Apr 19 03:41:22.671401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 231/499] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:22 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 35084 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:23.022749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f6a5fd29-7179-4289-aeb7-d40361fda4a2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:23.023411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f6a5fd29-7179-4289-aeb7-d40361fda4a2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:23.046173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f6a5fd29-7179-4289-aeb7-d40361fda4a2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:23.046847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f6a5fd29-7179-4289-aeb7-d40361fda4a2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:23.047913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f6a5fd29-7179-4289-aeb7-d40361fda4a2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:23.048583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f6a5fd29-7179-4289-aeb7-d40361fda4a2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:23.210342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-a710cf01-5a93-4769-b22d-7aba22920054 req-029d93f4-66b4-4671-8e53-4a2351b9092d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcad7e0c-ccda-4c71-a827-bcd885cd3b4f", "name": "network-vif-deleted", "tag": "5a6ffccc-34e3-42cc-a465-b55f727291e9"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:23.212659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:41:23.212659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:41:23.236685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-a710cf01-5a93-4769-b22d-7aba22920054 req-029d93f4-66b4-4671-8e53-4a2351b9092d service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:23.239746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-a710cf01-5a93-4769-b22d-7aba22920054 req-029d93f4-66b4-4671-8e53-4a2351b9092d service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:23.281489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-a710cf01-5a93-4769-b22d-7aba22920054 req-029d93f4-66b4-4671-8e53-4a2351b9092d service nova] Creating event network-vif-deleted:5a6ffccc-34e3-42cc-a465-b55f727291e9 for instance fcad7e0c-ccda-4c71-a827-bcd885cd3b4f on hv-cinder-78605 Apr 19 03:41:23.301981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-a710cf01-5a93-4769-b22d-7aba22920054 req-029d93f4-66b4-4671-8e53-4a2351b9092d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095954 Apr 19 03:41:23.302668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 232/500] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:41:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:41:23.377234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f6a5fd29-7179-4289-aeb7-d40361fda4a2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:23.393495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f6a5fd29-7179-4289-aeb7-d40361fda4a2 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1471 microversion: 2.1 time: 0.375222 Apr 19 03:41:23.396835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 269/501] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:23 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1471 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:23.621573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-285e2e68-1694-4d31-9144-5fe682f17e9a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:23.623300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-285e2e68-1694-4d31-9144-5fe682f17e9a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:23.632483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-285e2e68-1694-4d31-9144-5fe682f17e9a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:23.633895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-285e2e68-1694-4d31-9144-5fe682f17e9a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:23.634911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-285e2e68-1694-4d31-9144-5fe682f17e9a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:23.635600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-285e2e68-1694-4d31-9144-5fe682f17e9a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:23.685928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-afc15c2f-f684-413a-8653-dc045f2319c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:23.687791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-afc15c2f-f684-413a-8653-dc045f2319c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:23.705416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-afc15c2f-f684-413a-8653-dc045f2319c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:23.706187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-afc15c2f-f684-413a-8653-dc045f2319c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:23.707462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-afc15c2f-f684-413a-8653-dc045f2319c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:23.708112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-afc15c2f-f684-413a-8653-dc045f2319c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:23.873139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-afc15c2f-f684-413a-8653-dc045f2319c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 35551 microversion: 2.20 time: 0.194538 Apr 19 03:41:23.877489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 270/502] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:23 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 35551 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:23.976667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-285e2e68-1694-4d31-9144-5fe682f17e9a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:23.992128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-285e2e68-1694-4d31-9144-5fe682f17e9a tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1505 microversion: 2.1 time: 0.380018 Apr 19 03:41:23.993174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 233/503] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:23 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:24.416241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:24.419752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:24.455400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:24.456262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:24.458840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:24.460875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:24.701359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:24.702212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:24.702916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lazy-loading 'fault' on Instance uuid fcad7e0c-ccda-4c71-a827-bcd885cd3b4f {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:41:24.822448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:24.832223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6bd3850b-72d6-44cb-a959-0e792d9f081e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 200 len: 1308 microversion: 2.1 time: 0.421169 Apr 19 03:41:24.833064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 271/504] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:24 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:24.887024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-017e4669-55a5-4349-8239-8c1a105a1db5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:24.888218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-017e4669-55a5-4349-8239-8c1a105a1db5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:24.914453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-017e4669-55a5-4349-8239-8c1a105a1db5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:24.914453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-017e4669-55a5-4349-8239-8c1a105a1db5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:24.914453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-017e4669-55a5-4349-8239-8c1a105a1db5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:24.914453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-017e4669-55a5-4349-8239-8c1a105a1db5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:25.013552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7cca7281-24eb-4fb9-8740-923911948b04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:25.014595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7cca7281-24eb-4fb9-8740-923911948b04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:25.030293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cca7281-24eb-4fb9-8740-923911948b04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:25.033616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cca7281-24eb-4fb9-8740-923911948b04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:25.034717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cca7281-24eb-4fb9-8740-923911948b04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:25.036863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cca7281-24eb-4fb9-8740-923911948b04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:25.100960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-017e4669-55a5-4349-8239-8c1a105a1db5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 36240 microversion: 2.20 time: 0.218994 Apr 19 03:41:25.102112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 234/505] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:24 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 36240 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:25.692159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7cca7281-24eb-4fb9-8740-923911948b04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:25.702333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7cca7281-24eb-4fb9-8740-923911948b04 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1505 microversion: 2.1 time: 0.696123 Apr 19 03:41:25.703132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 272/506] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:25 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1505 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:25.851015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b1c7a60d-3eda-4791-ad73-a36b1fa829b4 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:25.851962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b1c7a60d-3eda-4791-ad73-a36b1fa829b4 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: fcad7e0c-ccda-4c71-a827-bcd885cd3b4f] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:25.862183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b1c7a60d-3eda-4791-ad73-a36b1fa829b4 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:25.862183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b1c7a60d-3eda-4791-ad73-a36b1fa829b4 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:25.864294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b1c7a60d-3eda-4791-ad73-a36b1fa829b4 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:25.864882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b1c7a60d-3eda-4791-ad73-a36b1fa829b4 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:25.940380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-b1c7a60d-3eda-4791-ad73-a36b1fa829b4 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] HTTP exception thrown: Instance fcad7e0c-ccda-4c71-a827-bcd885cd3b4f could not be found. Apr 19 03:41:25.941057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b1c7a60d-3eda-4791-ad73-a36b1fa829b4 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Returning 404 to user: Instance fcad7e0c-ccda-4c71-a827-bcd885cd3b4f could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:25.942238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b1c7a60d-3eda-4791-ad73-a36b1fa829b4 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f" status: 404 len: 111 microversion: 2.1 time: 0.095629 Apr 19 03:41:25.946774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 235/507] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:25 2021] GET /compute/v2.1/servers/fcad7e0c-ccda-4c71-a827-bcd885cd3b4f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:41:26.114750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-eaa400d4-9606-4cef-b68e-d10d70d21490 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:26.118619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-eaa400d4-9606-4cef-b68e-d10d70d21490 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:26.146390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaa400d4-9606-4cef-b68e-d10d70d21490 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:26.146830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaa400d4-9606-4cef-b68e-d10d70d21490 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:26.147789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaa400d4-9606-4cef-b68e-d10d70d21490 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:26.148350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaa400d4-9606-4cef-b68e-d10d70d21490 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:26.722568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d7ff078f-cf47-432f-b2e1-f4fb924fda35 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:26.728197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d7ff078f-cf47-432f-b2e1-f4fb924fda35 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:26.739910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7ff078f-cf47-432f-b2e1-f4fb924fda35 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:26.740764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7ff078f-cf47-432f-b2e1-f4fb924fda35 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:26.742091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7ff078f-cf47-432f-b2e1-f4fb924fda35 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:26.742857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7ff078f-cf47-432f-b2e1-f4fb924fda35 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:27.257638 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d7ff078f-cf47-432f-b2e1-f4fb924fda35 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:27.267387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d7ff078f-cf47-432f-b2e1-f4fb924fda35 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1505 microversion: 2.1 time: 0.549623 Apr 19 03:41:27.268639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 236/508] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:26 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:28.122748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-eaa400d4-9606-4cef-b68e-d10d70d21490 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 38175 microversion: 2.20 time: 2.005037 Apr 19 03:41:28.127117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 273/509] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:26 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 38175 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:28.141087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-c7eab9be-d3aa-4dd9-b653-43d1c42edf2f req-d771b5e8-5327-416e-a22b-5a0d7923988d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a261074-36d1-43c7-aa9f-3b01ef9b22de", "name": "network-vif-deleted", "tag": "60e9cad0-05d1-41b7-9493-d8716b118842"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:28.143331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:41:28.143331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:41:28.160275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-c7eab9be-d3aa-4dd9-b653-43d1c42edf2f req-d771b5e8-5327-416e-a22b-5a0d7923988d service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:28.162453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-c7eab9be-d3aa-4dd9-b653-43d1c42edf2f req-d771b5e8-5327-416e-a22b-5a0d7923988d service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:28.184610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-c7eab9be-d3aa-4dd9-b653-43d1c42edf2f req-d771b5e8-5327-416e-a22b-5a0d7923988d service nova] Creating event network-vif-deleted:60e9cad0-05d1-41b7-9493-d8716b118842 for instance 6a261074-36d1-43c7-aa9f-3b01ef9b22de on hv-cinder-78605 Apr 19 03:41:28.190972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-c7eab9be-d3aa-4dd9-b653-43d1c42edf2f req-d771b5e8-5327-416e-a22b-5a0d7923988d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054029 Apr 19 03:41:28.192026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 237/510] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:41:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:41:28.291402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8849f737-23b0-41a9-a0f7-3f4ca278e8bc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:28.292290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8849f737-23b0-41a9-a0f7-3f4ca278e8bc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:28.301946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8849f737-23b0-41a9-a0f7-3f4ca278e8bc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:28.302684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8849f737-23b0-41a9-a0f7-3f4ca278e8bc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:28.307494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8849f737-23b0-41a9-a0f7-3f4ca278e8bc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:28.308362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8849f737-23b0-41a9-a0f7-3f4ca278e8bc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:28.497271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8849f737-23b0-41a9-a0f7-3f4ca278e8bc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:28.514716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8849f737-23b0-41a9-a0f7-3f4ca278e8bc tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 200 len: 1291 microversion: 2.1 time: 0.232243 Apr 19 03:41:28.517547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 274/511] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:28 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 1291 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:28.674791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-df011c38-2185-418c-b04b-388721b40b7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:28.679544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-df011c38-2185-418c-b04b-388721b40b7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:28.695941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df011c38-2185-418c-b04b-388721b40b7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:28.696643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df011c38-2185-418c-b04b-388721b40b7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:28.697660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df011c38-2185-418c-b04b-388721b40b7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:28.698306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df011c38-2185-418c-b04b-388721b40b7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:28.811284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-df011c38-2185-418c-b04b-388721b40b7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:41:29.099133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-df011c38-2185-418c-b04b-388721b40b7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 204 len: 0 microversion: 2.1 time: 0.425427 Apr 19 03:41:29.100974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 238/512] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:41:28 2021] DELETE /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:41:29.110693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dfb2a939-56a2-4aba-95da-ec3df66eb9fc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:29.112000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dfb2a939-56a2-4aba-95da-ec3df66eb9fc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:29.130198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfb2a939-56a2-4aba-95da-ec3df66eb9fc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:29.131578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfb2a939-56a2-4aba-95da-ec3df66eb9fc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:29.132640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfb2a939-56a2-4aba-95da-ec3df66eb9fc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:29.135803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e918786d-cdfa-4566-959a-c491aa4e4061 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:29.136127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfb2a939-56a2-4aba-95da-ec3df66eb9fc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:29.137218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e918786d-cdfa-4566-959a-c491aa4e4061 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:29.156151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e918786d-cdfa-4566-959a-c491aa4e4061 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:29.156667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e918786d-cdfa-4566-959a-c491aa4e4061 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:29.167454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e918786d-cdfa-4566-959a-c491aa4e4061 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:29.167454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e918786d-cdfa-4566-959a-c491aa4e4061 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:29.382398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e918786d-cdfa-4566-959a-c491aa4e4061 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 38230 microversion: 2.20 time: 0.251109 Apr 19 03:41:29.384306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 239/513] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:29 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 38230 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:29.547623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ebe7f9fb-b688-4c0f-816d-c0718d9c9915 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:29.548421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ebe7f9fb-b688-4c0f-816d-c0718d9c9915 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 6a261074-36d1-43c7-aa9f-3b01ef9b22de] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:29.588297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ebe7f9fb-b688-4c0f-816d-c0718d9c9915 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:29.588811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ebe7f9fb-b688-4c0f-816d-c0718d9c9915 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:29.589673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ebe7f9fb-b688-4c0f-816d-c0718d9c9915 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:29.590175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ebe7f9fb-b688-4c0f-816d-c0718d9c9915 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:29.693953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-ebe7f9fb-b688-4c0f-816d-c0718d9c9915 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] HTTP exception thrown: Instance 6a261074-36d1-43c7-aa9f-3b01ef9b22de could not be found. Apr 19 03:41:29.694886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ebe7f9fb-b688-4c0f-816d-c0718d9c9915 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Returning 404 to user: Instance 6a261074-36d1-43c7-aa9f-3b01ef9b22de could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:29.696909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ebe7f9fb-b688-4c0f-816d-c0718d9c9915 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de" status: 404 len: 111 microversion: 2.1 time: 0.166781 Apr 19 03:41:29.697511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 240/514] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:29 2021] GET /compute/v2.1/servers/6a261074-36d1-43c7-aa9f-3b01ef9b22de => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:41:29.707977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-93844935-5b86-48dc-aa2e-d421412ed64d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:29.710439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-93844935-5b86-48dc-aa2e-d421412ed64d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:29.728811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93844935-5b86-48dc-aa2e-d421412ed64d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:29.731274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93844935-5b86-48dc-aa2e-d421412ed64d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:29.731274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93844935-5b86-48dc-aa2e-d421412ed64d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:29.731274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93844935-5b86-48dc-aa2e-d421412ed64d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:29.860720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-93844935-5b86-48dc-aa2e-d421412ed64d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:41:30.030350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dfb2a939-56a2-4aba-95da-ec3df66eb9fc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:30.040069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dfb2a939-56a2-4aba-95da-ec3df66eb9fc tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1513 microversion: 2.1 time: 0.933400 Apr 19 03:41:30.041037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 275/515] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:29 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1513 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:30.396745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-931163a7-4e81-4b1e-aaa5-c26a9110d4ad tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:30.397946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-931163a7-4e81-4b1e-aaa5-c26a9110d4ad tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:30.402431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-93844935-5b86-48dc-aa2e-d421412ed64d tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 204 len: 0 microversion: 2.1 time: 0.699602 Apr 19 03:41:30.403864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 241/516] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:41:29 2021] DELETE /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:41:30.408163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-931163a7-4e81-4b1e-aaa5-c26a9110d4ad tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:30.412072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-931163a7-4e81-4b1e-aaa5-c26a9110d4ad tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:30.413176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-931163a7-4e81-4b1e-aaa5-c26a9110d4ad tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:30.414020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-931163a7-4e81-4b1e-aaa5-c26a9110d4ad tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:30.415385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5d6fe68a-c5a9-499c-ba9a-7e76c1c39f6b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:30.416290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5d6fe68a-c5a9-499c-ba9a-7e76c1c39f6b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:30.427768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5d6fe68a-c5a9-499c-ba9a-7e76c1c39f6b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:30.428092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5d6fe68a-c5a9-499c-ba9a-7e76c1c39f6b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:30.429181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5d6fe68a-c5a9-499c-ba9a-7e76c1c39f6b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:30.429897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5d6fe68a-c5a9-499c-ba9a-7e76c1c39f6b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:30.611950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-931163a7-4e81-4b1e-aaa5-c26a9110d4ad tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 38230 microversion: 2.20 time: 0.220256 Apr 19 03:41:30.619795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 276/517] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:30 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 38230 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:41:30.924295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5d6fe68a-c5a9-499c-ba9a-7e76c1c39f6b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:30.934158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5d6fe68a-c5a9-499c-ba9a-7e76c1c39f6b tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.525685 Apr 19 03:41:30.935531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 242/518] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:30 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:31.059860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f67a0e9e-a6d3-492e-a51f-eaaa93bcde98 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:31.060882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f67a0e9e-a6d3-492e-a51f-eaaa93bcde98 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:31.070445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f67a0e9e-a6d3-492e-a51f-eaaa93bcde98 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:31.071312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f67a0e9e-a6d3-492e-a51f-eaaa93bcde98 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:31.072364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f67a0e9e-a6d3-492e-a51f-eaaa93bcde98 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:31.073126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f67a0e9e-a6d3-492e-a51f-eaaa93bcde98 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:31.543531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f67a0e9e-a6d3-492e-a51f-eaaa93bcde98 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:31.553903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f67a0e9e-a6d3-492e-a51f-eaaa93bcde98 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1513 microversion: 2.1 time: 0.499516 Apr 19 03:41:31.555745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 277/519] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:31 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1513 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:31.629086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3c1e4fe9-3140-4151-aff4-0e9dcc025c27 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:31.631078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3c1e4fe9-3140-4151-aff4-0e9dcc025c27 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:31.651428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c1e4fe9-3140-4151-aff4-0e9dcc025c27 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:31.659039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c1e4fe9-3140-4151-aff4-0e9dcc025c27 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:31.661198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c1e4fe9-3140-4151-aff4-0e9dcc025c27 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:31.663826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c1e4fe9-3140-4151-aff4-0e9dcc025c27 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:31.872701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3c1e4fe9-3140-4151-aff4-0e9dcc025c27 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 38230 microversion: 2.20 time: 0.248346 Apr 19 03:41:31.873611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 243/520] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:31 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 38230 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:41:31.954830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8f3455e9-9c59-43ae-9100-6142fd30ce5e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:31.955555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8f3455e9-9c59-43ae-9100-6142fd30ce5e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:31.973025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f3455e9-9c59-43ae-9100-6142fd30ce5e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:31.973578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f3455e9-9c59-43ae-9100-6142fd30ce5e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:31.974467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f3455e9-9c59-43ae-9100-6142fd30ce5e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:31.975247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f3455e9-9c59-43ae-9100-6142fd30ce5e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:32.572786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f84a33e4-e154-40a2-b11b-ef9eb0213375 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:32.573541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f84a33e4-e154-40a2-b11b-ef9eb0213375 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:32.584482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8f3455e9-9c59-43ae-9100-6142fd30ce5e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:32.599133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f84a33e4-e154-40a2-b11b-ef9eb0213375 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:32.599725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8f3455e9-9c59-43ae-9100-6142fd30ce5e tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.646166 Apr 19 03:41:32.611800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 278/521] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:31 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:32.617963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f84a33e4-e154-40a2-b11b-ef9eb0213375 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:32.618881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f84a33e4-e154-40a2-b11b-ef9eb0213375 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:32.619411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f84a33e4-e154-40a2-b11b-ef9eb0213375 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:32.894077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-36778073-c63f-45ac-bfc2-2eb243044bd5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:32.895289 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-36778073-c63f-45ac-bfc2-2eb243044bd5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:32.911157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36778073-c63f-45ac-bfc2-2eb243044bd5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:32.912049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36778073-c63f-45ac-bfc2-2eb243044bd5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:32.913108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36778073-c63f-45ac-bfc2-2eb243044bd5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:32.913843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36778073-c63f-45ac-bfc2-2eb243044bd5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:33.057734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-36778073-c63f-45ac-bfc2-2eb243044bd5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 38230 microversion: 2.20 time: 0.175823 Apr 19 03:41:33.059598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 279/522] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:32 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 38230 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:33.336605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-33271640-3fd3-4291-b2f5-656bacbcafd3 req-0d3f52c5-ee0f-44dc-a762-20302d8a0b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22be386b-f516-47e4-8c1a-4ceadfb6af9b", "name": "network-vif-deleted", "tag": "7f73b7d8-7f40-4b4b-8ce9-0712f3b4e188"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:33.336717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f84a33e4-e154-40a2-b11b-ef9eb0213375 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:33.351053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:41:33.351053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:41:33.363193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f84a33e4-e154-40a2-b11b-ef9eb0213375 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 200 len: 1471 microversion: 2.1 time: 0.792840 Apr 19 03:41:33.363193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 244/523] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:32 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 1471 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:33.373014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-33271640-3fd3-4291-b2f5-656bacbcafd3 req-0d3f52c5-ee0f-44dc-a762-20302d8a0b5e service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:33.374100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-33271640-3fd3-4291-b2f5-656bacbcafd3 req-0d3f52c5-ee0f-44dc-a762-20302d8a0b5e service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:33.412790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-33271640-3fd3-4291-b2f5-656bacbcafd3 req-0d3f52c5-ee0f-44dc-a762-20302d8a0b5e service nova] Creating event network-vif-deleted:7f73b7d8-7f40-4b4b-8ce9-0712f3b4e188 for instance 22be386b-f516-47e4-8c1a-4ceadfb6af9b on hv-cinder-78605 Apr 19 03:41:33.419443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-33271640-3fd3-4291-b2f5-656bacbcafd3 req-0d3f52c5-ee0f-44dc-a762-20302d8a0b5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095406 Apr 19 03:41:33.420389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 280/524] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:41:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:41:33.620587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1fd1802a-8c3d-406d-bc96-72f7e3a0e6b6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:33.622457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1fd1802a-8c3d-406d-bc96-72f7e3a0e6b6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:33.638724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1fd1802a-8c3d-406d-bc96-72f7e3a0e6b6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:33.639294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1fd1802a-8c3d-406d-bc96-72f7e3a0e6b6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:33.640389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1fd1802a-8c3d-406d-bc96-72f7e3a0e6b6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:33.640844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1fd1802a-8c3d-406d-bc96-72f7e3a0e6b6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:34.074867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-91b27dba-8d5f-48ed-b434-1b44d992015e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:34.075997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-91b27dba-8d5f-48ed-b434-1b44d992015e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:34.091402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91b27dba-8d5f-48ed-b434-1b44d992015e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:34.092102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91b27dba-8d5f-48ed-b434-1b44d992015e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:34.097194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91b27dba-8d5f-48ed-b434-1b44d992015e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:34.098092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91b27dba-8d5f-48ed-b434-1b44d992015e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:34.169509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1fd1802a-8c3d-406d-bc96-72f7e3a0e6b6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:34.178694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1fd1802a-8c3d-406d-bc96-72f7e3a0e6b6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.563346 Apr 19 03:41:34.179878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 245/525] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:33 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:34.272626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-91b27dba-8d5f-48ed-b434-1b44d992015e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 200 len: 38373 microversion: 2.20 time: 0.205779 Apr 19 03:41:34.279346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 281/526] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:34 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 38373 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:34.285901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5c9dfd8e-b47a-4445-8a14-71d1d60085c1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:34.296049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5c9dfd8e-b47a-4445-8a14-71d1d60085c1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:34.313515 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9dfd8e-b47a-4445-8a14-71d1d60085c1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:34.314033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9dfd8e-b47a-4445-8a14-71d1d60085c1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:34.314884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9dfd8e-b47a-4445-8a14-71d1d60085c1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:34.315432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9dfd8e-b47a-4445-8a14-71d1d60085c1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:34.382362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-21e249ed-7c45-4a0c-bbd6-afd4439753cf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:34.383378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-21e249ed-7c45-4a0c-bbd6-afd4439753cf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 22be386b-f516-47e4-8c1a-4ceadfb6af9b] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:34.401176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21e249ed-7c45-4a0c-bbd6-afd4439753cf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:34.403600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21e249ed-7c45-4a0c-bbd6-afd4439753cf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:34.407474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5c9dfd8e-b47a-4445-8a14-71d1d60085c1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/ips" status: 200 len: 151 microversion: 2.20 time: 0.125878 Apr 19 03:41:34.408427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 246/527] 10.222.0.25 () {60 vars in 1279 bytes} [Mon Apr 19 03:41:34 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/ips => generated 151 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:41:34.415263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21e249ed-7c45-4a0c-bbd6-afd4439753cf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:34.416694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21e249ed-7c45-4a0c-bbd6-afd4439753cf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:34.507633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-21e249ed-7c45-4a0c-bbd6-afd4439753cf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] HTTP exception thrown: Instance 22be386b-f516-47e4-8c1a-4ceadfb6af9b could not be found. Apr 19 03:41:34.509388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-21e249ed-7c45-4a0c-bbd6-afd4439753cf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Returning 404 to user: Instance 22be386b-f516-47e4-8c1a-4ceadfb6af9b could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:34.510439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-21e249ed-7c45-4a0c-bbd6-afd4439753cf tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b" status: 404 len: 111 microversion: 2.1 time: 0.134373 Apr 19 03:41:34.511576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 282/528] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:34 2021] GET /compute/v2.1/servers/22be386b-f516-47e4-8c1a-4ceadfb6af9b => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:41:34.521189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-aa010237-b99a-426f-8e5a-f42913327410 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:34.521975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-aa010237-b99a-426f-8e5a-f42913327410 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:34.535020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aa010237-b99a-426f-8e5a-f42913327410 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:34.535842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aa010237-b99a-426f-8e5a-f42913327410 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:34.536961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aa010237-b99a-426f-8e5a-f42913327410 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:34.537756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aa010237-b99a-426f-8e5a-f42913327410 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:34.683366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-aa010237-b99a-426f-8e5a-f42913327410 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:41:34.974528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-aa010237-b99a-426f-8e5a-f42913327410 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 204 len: 0 microversion: 2.1 time: 0.458241 Apr 19 03:41:34.981515 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 247/529] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:41:34 2021] DELETE /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:41:34.994900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-72bb89b3-1e69-4532-aa85-3f36a46b010b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:35.007304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-72bb89b3-1e69-4532-aa85-3f36a46b010b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:35.007494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2639668c-2f18-43f4-96b9-76b356e55ae0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Action: 'create', calling method: .version_select at 0x7f9dac5af840>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-785891168"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:35.007614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72bb89b3-1e69-4532-aa85-3f36a46b010b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:35.007614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72bb89b3-1e69-4532-aa85-3f36a46b010b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:35.007614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72bb89b3-1e69-4532-aa85-3f36a46b010b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:35.008907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72bb89b3-1e69-4532-aa85-3f36a46b010b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:35.025093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-2639668c-2f18-43f4-96b9-76b356e55ae0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Getting quotas for project a012a767fda74dde8c60610167f3a08a. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:41:35.030016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-2639668c-2f18-43f4-96b9-76b356e55ae0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Getting quotas for user 0e8af417bbfa4deda2c64b88a8d5c6ed and project a012a767fda74dde8c60610167f3a08a. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:41:35.284523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-72bb89b3-1e69-4532-aa85-3f36a46b010b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:35.296027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-72bb89b3-1e69-4532-aa85-3f36a46b010b tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1513 microversion: 2.1 time: 0.311790 Apr 19 03:41:35.301188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 248/530] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:34 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1513 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:35.306064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3f2fecf9-23ba-4442-a7fc-655923600b62 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:35.306064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3f2fecf9-23ba-4442-a7fc-655923600b62 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:35.316080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f2fecf9-23ba-4442-a7fc-655923600b62 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:35.316605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f2fecf9-23ba-4442-a7fc-655923600b62 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:35.318122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f2fecf9-23ba-4442-a7fc-655923600b62 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:35.320923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f2fecf9-23ba-4442-a7fc-655923600b62 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:35.366684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-2639668c-2f18-43f4-96b9-76b356e55ae0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Getting quotas for project a012a767fda74dde8c60610167f3a08a. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:41:35.372536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-2639668c-2f18-43f4-96b9-76b356e55ae0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Getting quotas for user 0e8af417bbfa4deda2c64b88a8d5c6ed and project a012a767fda74dde8c60610167f3a08a. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:41:35.387574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2639668c-2f18-43f4-96b9-76b356e55ae0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.795493 Apr 19 03:41:35.388709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 283/531] 10.222.0.25 () {60 vars in 1148 bytes} [Mon Apr 19 03:41:34 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:35.640961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3f2fecf9-23ba-4442-a7fc-655923600b62 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:35.652349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3f2fecf9-23ba-4442-a7fc-655923600b62 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 0.353341 Apr 19 03:41:35.652990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 249/532] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:35 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:36.330770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bf2929b8-1734-48cc-8d1a-372905cd071e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:36.331512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bf2929b8-1734-48cc-8d1a-372905cd071e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:36.344971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf2929b8-1734-48cc-8d1a-372905cd071e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:36.345486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf2929b8-1734-48cc-8d1a-372905cd071e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:36.346350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf2929b8-1734-48cc-8d1a-372905cd071e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:36.346847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf2929b8-1734-48cc-8d1a-372905cd071e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:36.670774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-56d5c839-f8a9-4b86-9009-d396d7f381f4 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:36.673888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-56d5c839-f8a9-4b86-9009-d396d7f381f4 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:36.686779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56d5c839-f8a9-4b86-9009-d396d7f381f4 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:36.687323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56d5c839-f8a9-4b86-9009-d396d7f381f4 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:36.688188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56d5c839-f8a9-4b86-9009-d396d7f381f4 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:36.688679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56d5c839-f8a9-4b86-9009-d396d7f381f4 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:37.002897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bf2929b8-1734-48cc-8d1a-372905cd071e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:37.017184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bf2929b8-1734-48cc-8d1a-372905cd071e tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1513 microversion: 2.1 time: 0.706132 Apr 19 03:41:37.027390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 284/533] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:36 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1513 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:37.483502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5961812c-7c24-441f-a27b-84dc107b6578 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:37.484624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5961812c-7c24-441f-a27b-84dc107b6578 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:37.494256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5961812c-7c24-441f-a27b-84dc107b6578 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:37.494981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5961812c-7c24-441f-a27b-84dc107b6578 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:37.496023 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5961812c-7c24-441f-a27b-84dc107b6578 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:37.496661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5961812c-7c24-441f-a27b-84dc107b6578 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:37.596766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-5961812c-7c24-441f-a27b-84dc107b6578 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lazy-loading 'flavor' on Instance uuid e29b14f0-f43c-434b-b583-cdf6b0e4b784 {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:41:37.881822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-56d5c839-f8a9-4b86-9009-d396d7f381f4 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:37.898049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-56d5c839-f8a9-4b86-9009-d396d7f381f4 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1521 microversion: 2.1 time: 1.231301 Apr 19 03:41:37.908990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 250/534] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:36 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1521 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:38.035786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0091fde7-e718-4369-8227-e77e86141027 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:38.036451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0091fde7-e718-4369-8227-e77e86141027 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:38.045036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0091fde7-e718-4369-8227-e77e86141027 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:38.045515 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0091fde7-e718-4369-8227-e77e86141027 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:38.046570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0091fde7-e718-4369-8227-e77e86141027 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:38.047277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0091fde7-e718-4369-8227-e77e86141027 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:38.169761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5961812c-7c24-441f-a27b-84dc107b6578 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 202 len: 0 microversion: 2.20 time: 0.689366 Apr 19 03:41:38.171185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 285/535] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:41:37 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:41:38.181078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-20a9e2d1-5fc1-4ca7-a1ae-6409dfd38181 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:38.181874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-20a9e2d1-5fc1-4ca7-a1ae-6409dfd38181 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:38.192231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20a9e2d1-5fc1-4ca7-a1ae-6409dfd38181 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:38.192746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20a9e2d1-5fc1-4ca7-a1ae-6409dfd38181 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:38.193622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20a9e2d1-5fc1-4ca7-a1ae-6409dfd38181 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:38.195050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20a9e2d1-5fc1-4ca7-a1ae-6409dfd38181 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:38.750014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20a9e2d1-5fc1-4ca7-a1ae-6409dfd38181 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:38.770867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20a9e2d1-5fc1-4ca7-a1ae-6409dfd38181 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:38.778060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20a9e2d1-5fc1-4ca7-a1ae-6409dfd38181 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:38.780116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-20a9e2d1-5fc1-4ca7-a1ae-6409dfd38181 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1723 microversion: 2.20 time: 0.604213 Apr 19 03:41:38.780379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 286/536] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:38 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1723 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:38.856572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0091fde7-e718-4369-8227-e77e86141027 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:38.863069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-cc06f5e0-e937-4c0c-9aab-b149d69537d5 req-10d48012-c208-48a7-990d-1e3c5ced4f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22", "name": "network-vif-deleted", "tag": "f3d9b8ab-bbd3-4640-81fd-67706cd12ecc"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:38.863983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:41:38.863983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:41:38.875129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-cc06f5e0-e937-4c0c-9aab-b149d69537d5 req-10d48012-c208-48a7-990d-1e3c5ced4f51 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:38.875840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-cc06f5e0-e937-4c0c-9aab-b149d69537d5 req-10d48012-c208-48a7-990d-1e3c5ced4f51 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:38.875989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0091fde7-e718-4369-8227-e77e86141027 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 200 len: 1513 microversion: 2.1 time: 0.844439 Apr 19 03:41:38.876645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 251/537] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:38 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 1513 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:41:38.920633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5fce982b-2d52-4cc8-8868-0eec5c0b988f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:38.921629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5fce982b-2d52-4cc8-8868-0eec5c0b988f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:38.927226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-cc06f5e0-e937-4c0c-9aab-b149d69537d5 req-10d48012-c208-48a7-990d-1e3c5ced4f51 service nova] Creating event network-vif-deleted:f3d9b8ab-bbd3-4640-81fd-67706cd12ecc for instance 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 on hv-cinder-78605 Apr 19 03:41:38.934827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5fce982b-2d52-4cc8-8868-0eec5c0b988f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:38.944678 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5fce982b-2d52-4cc8-8868-0eec5c0b988f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:38.947559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-cc06f5e0-e937-4c0c-9aab-b149d69537d5 req-10d48012-c208-48a7-990d-1e3c5ced4f51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101017 Apr 19 03:41:38.950280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5fce982b-2d52-4cc8-8868-0eec5c0b988f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:38.950280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5fce982b-2d52-4cc8-8868-0eec5c0b988f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:38.954479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 287/538] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:41:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:41:39.260760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5fce982b-2d52-4cc8-8868-0eec5c0b988f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249f3b7d8ae4291b4355be0268f92c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a5401a5a47449f9da4c9331362b020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:39.274543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5fce982b-2d52-4cc8-8868-0eec5c0b988f tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 200 len: 1307 microversion: 2.1 time: 0.361425 Apr 19 03:41:39.276568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 252/539] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:38 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 1307 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:39.804527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0a80c4a2-77c1-4b47-9fc3-a9b24eeccef1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:39.804527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0a80c4a2-77c1-4b47-9fc3-a9b24eeccef1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:39.818466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a80c4a2-77c1-4b47-9fc3-a9b24eeccef1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:39.818926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a80c4a2-77c1-4b47-9fc3-a9b24eeccef1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:39.821457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a80c4a2-77c1-4b47-9fc3-a9b24eeccef1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:39.828947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a80c4a2-77c1-4b47-9fc3-a9b24eeccef1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:39.894298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-21430f83-78aa-4af0-8348-4928e0d5bf7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:39.894980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-21430f83-78aa-4af0-8348-4928e0d5bf7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: 04b33f3c-869a-4151-b3a8-c8a05fc75694] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:39.931648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21430f83-78aa-4af0-8348-4928e0d5bf7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:39.932196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21430f83-78aa-4af0-8348-4928e0d5bf7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:39.943819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21430f83-78aa-4af0-8348-4928e0d5bf7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:39.948127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21430f83-78aa-4af0-8348-4928e0d5bf7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:40.071768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-21430f83-78aa-4af0-8348-4928e0d5bf7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] HTTP exception thrown: Instance 04b33f3c-869a-4151-b3a8-c8a05fc75694 could not be found. Apr 19 03:41:40.073865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-21430f83-78aa-4af0-8348-4928e0d5bf7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Returning 404 to user: Instance 04b33f3c-869a-4151-b3a8-c8a05fc75694 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:40.077239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-21430f83-78aa-4af0-8348-4928e0d5bf7f tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694" status: 404 len: 111 microversion: 2.1 time: 0.187331 Apr 19 03:41:40.077876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 253/540] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:39 2021] GET /compute/v2.1/servers/04b33f3c-869a-4151-b3a8-c8a05fc75694 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:41:40.296013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6e216cde-0e1a-48c5-94a8-6dd78abc20a6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:40.301248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6e216cde-0e1a-48c5-94a8-6dd78abc20a6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] [instance: 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:40.310006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e216cde-0e1a-48c5-94a8-6dd78abc20a6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:40.310728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e216cde-0e1a-48c5-94a8-6dd78abc20a6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:40.312074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e216cde-0e1a-48c5-94a8-6dd78abc20a6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:40.312685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e216cde-0e1a-48c5-94a8-6dd78abc20a6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:40.426511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-6e216cde-0e1a-48c5-94a8-6dd78abc20a6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] HTTP exception thrown: Instance 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 could not be found. Apr 19 03:41:40.434957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6e216cde-0e1a-48c5-94a8-6dd78abc20a6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] Returning 404 to user: Instance 8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:40.439990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6e216cde-0e1a-48c5-94a8-6dd78abc20a6 tempest-ServerRescueNegativeTestJSON-1707193860 tempest-ServerRescueNegativeTestJSON-1707193860-project] 10.222.0.25 "GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22" status: 404 len: 111 microversion: 2.1 time: 0.147995 Apr 19 03:41:40.444257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 254/541] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:40 2021] GET /compute/v2.1/servers/8fa8f3ff-b68d-42db-8443-ce5c2eb4bd22 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:41:40.477848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0a80c4a2-77c1-4b47-9fc3-a9b24eeccef1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:40.495299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0a80c4a2-77c1-4b47-9fc3-a9b24eeccef1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:40.497126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0a80c4a2-77c1-4b47-9fc3-a9b24eeccef1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:40.498689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0a80c4a2-77c1-4b47-9fc3-a9b24eeccef1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1723 microversion: 2.20 time: 0.700601 Apr 19 03:41:40.510310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 288/542] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:39 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1723 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:40.999040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-8a794b33-dd4b-4d76-bd15-2fd26ba614e1 req-31b7b707-e3ee-4a1e-ba44-75b7e0b3689f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b33f3c-869a-4151-b3a8-c8a05fc75694", "name": "network-vif-deleted", "tag": "079573e4-5310-4589-883b-946da48f3377"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:41.000865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:41:41.000865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:41:41.022083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-8a794b33-dd4b-4d76-bd15-2fd26ba614e1 req-31b7b707-e3ee-4a1e-ba44-75b7e0b3689f service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:41.029268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-8a794b33-dd4b-4d76-bd15-2fd26ba614e1 req-31b7b707-e3ee-4a1e-ba44-75b7e0b3689f service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:41.057318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-8a794b33-dd4b-4d76-bd15-2fd26ba614e1 req-31b7b707-e3ee-4a1e-ba44-75b7e0b3689f service nova] Creating event network-vif-deleted:079573e4-5310-4589-883b-946da48f3377 for instance 04b33f3c-869a-4151-b3a8-c8a05fc75694 on hv-cinder-78605 Apr 19 03:41:41.074476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-8a794b33-dd4b-4d76-bd15-2fd26ba614e1 req-31b7b707-e3ee-4a1e-ba44-75b7e0b3689f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079292 Apr 19 03:41:41.075233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 255/543] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:41:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:41:41.518450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0095465e-1493-41ef-8942-4bf0e9ca4e0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:41.519427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0095465e-1493-41ef-8942-4bf0e9ca4e0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:41.529202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0095465e-1493-41ef-8942-4bf0e9ca4e0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:41.529999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0095465e-1493-41ef-8942-4bf0e9ca4e0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:41.531647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0095465e-1493-41ef-8942-4bf0e9ca4e0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:41.532305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0095465e-1493-41ef-8942-4bf0e9ca4e0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:41.668519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7fe45c7e-9472-4d5b-999a-6b4a7e49a414 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:41.669441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7fe45c7e-9472-4d5b-999a-6b4a7e49a414 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:41.687751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7fe45c7e-9472-4d5b-999a-6b4a7e49a414 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:41.688611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7fe45c7e-9472-4d5b-999a-6b4a7e49a414 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:41.692139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7fe45c7e-9472-4d5b-999a-6b4a7e49a414 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:41.692813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7fe45c7e-9472-4d5b-999a-6b4a7e49a414 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:41.857612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7fe45c7e-9472-4d5b-999a-6b4a7e49a414 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:41:42.081463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0095465e-1493-41ef-8942-4bf0e9ca4e0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:42.095634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0095465e-1493-41ef-8942-4bf0e9ca4e0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:42.097625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0095465e-1493-41ef-8942-4bf0e9ca4e0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:42.099471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0095465e-1493-41ef-8942-4bf0e9ca4e0a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1723 microversion: 2.20 time: 0.585215 Apr 19 03:41:42.100108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 289/544] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:41 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1723 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:42.253585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7fe45c7e-9472-4d5b-999a-6b4a7e49a414 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 204 len: 0 microversion: 2.1 time: 0.589549 Apr 19 03:41:42.254720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 256/545] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:41:41 2021] DELETE /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:41:42.270872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7f76b54c-9b87-4308-9dee-e4cd5fad50df tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:42.270872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7f76b54c-9b87-4308-9dee-e4cd5fad50df tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:42.283441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f76b54c-9b87-4308-9dee-e4cd5fad50df tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:42.284598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f76b54c-9b87-4308-9dee-e4cd5fad50df tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:42.286493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f76b54c-9b87-4308-9dee-e4cd5fad50df tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:42.288822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f76b54c-9b87-4308-9dee-e4cd5fad50df tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:43.011177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7f76b54c-9b87-4308-9dee-e4cd5fad50df tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:43.031313 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7f76b54c-9b87-4308-9dee-e4cd5fad50df tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1513 microversion: 2.1 time: 0.771865 Apr 19 03:41:43.031966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 290/546] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:42 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1513 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:43.139466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f0756e3d-2d44-49be-98c3-c3898575db7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:43.140413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f0756e3d-2d44-49be-98c3-c3898575db7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:43.170986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0756e3d-2d44-49be-98c3-c3898575db7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:43.171536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0756e3d-2d44-49be-98c3-c3898575db7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:43.172384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0756e3d-2d44-49be-98c3-c3898575db7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:43.172866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0756e3d-2d44-49be-98c3-c3898575db7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:44.231632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-92c721e9-a3a2-4ae5-8610-22132c82dc4a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Action: 'create', calling method: .version_select at 0x7f9dac6c16a8>, body: {"keypair": {"name": "tempest-TestShelveInstance-289167008"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:44.269567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-92c721e9-a3a2-4ae5-8610-22132c82dc4a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Getting quotas for project 9685547739384db983b365ae780e9d90. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:41:44.280073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-92c721e9-a3a2-4ae5-8610-22132c82dc4a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Getting quotas for user 7857d2962cae4aed923735a1ebe781f0 and project 9685547739384db983b365ae780e9d90. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:41:44.330181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f0756e3d-2d44-49be-98c3-c3898575db7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:44.344329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f0756e3d-2d44-49be-98c3-c3898575db7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:44.346259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f0756e3d-2d44-49be-98c3-c3898575db7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:44.348083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f0756e3d-2d44-49be-98c3-c3898575db7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1723 microversion: 2.20 time: 1.231876 Apr 19 03:41:44.349222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 257/547] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:43 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1723 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:44.355936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-93b91861-67b5-49fe-8461-4d594bcf2e94 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:44.356791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-93b91861-67b5-49fe-8461-4d594bcf2e94 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:44.368656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93b91861-67b5-49fe-8461-4d594bcf2e94 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:44.369876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93b91861-67b5-49fe-8461-4d594bcf2e94 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:44.371205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93b91861-67b5-49fe-8461-4d594bcf2e94 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:44.371908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93b91861-67b5-49fe-8461-4d594bcf2e94 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:44.522370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-92c721e9-a3a2-4ae5-8610-22132c82dc4a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Getting quotas for project 9685547739384db983b365ae780e9d90. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:41:44.527428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-92c721e9-a3a2-4ae5-8610-22132c82dc4a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Getting quotas for user 7857d2962cae4aed923735a1ebe781f0 and project 9685547739384db983b365ae780e9d90. Resources: {'key_pairs'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:41:44.542282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-92c721e9-a3a2-4ae5-8610-22132c82dc4a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.648283 Apr 19 03:41:44.548209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 291/548] 10.222.0.25 () {60 vars in 1148 bytes} [Mon Apr 19 03:41:43 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:45.134670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-93b91861-67b5-49fe-8461-4d594bcf2e94 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:45.147452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-93b91861-67b5-49fe-8461-4d594bcf2e94 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1513 microversion: 2.1 time: 0.796478 Apr 19 03:41:45.149033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 258/549] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:44 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1513 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:45.369635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-576595ca-125c-4b43-b8a8-34e1dae1bbdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:45.370480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-576595ca-125c-4b43-b8a8-34e1dae1bbdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:45.379959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-576595ca-125c-4b43-b8a8-34e1dae1bbdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:45.383222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-576595ca-125c-4b43-b8a8-34e1dae1bbdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:45.384266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-576595ca-125c-4b43-b8a8-34e1dae1bbdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:45.387741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-576595ca-125c-4b43-b8a8-34e1dae1bbdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:45.783645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-576595ca-125c-4b43-b8a8-34e1dae1bbdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:45.790917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-871953fc-8cb1-46b8-9681-bd4b045bad6e req-4b91cfab-6281-4be6-a52f-d4417883e815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e896d6d6-dd30-46c4-a04f-e9225a22a58d", "name": "network-vif-deleted", "tag": "bb2c34ca-6d45-4472-864f-42de8bae8411"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:45.797677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:41:45.797677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:41:45.809339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-576595ca-125c-4b43-b8a8-34e1dae1bbdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:45.818614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-576595ca-125c-4b43-b8a8-34e1dae1bbdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:45.834036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-576595ca-125c-4b43-b8a8-34e1dae1bbdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1723 microversion: 2.20 time: 0.455585 Apr 19 03:41:45.835321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-871953fc-8cb1-46b8-9681-bd4b045bad6e req-4b91cfab-6281-4be6-a52f-d4417883e815 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:45.837450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-871953fc-8cb1-46b8-9681-bd4b045bad6e req-4b91cfab-6281-4be6-a52f-d4417883e815 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:45.847252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 292/550] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:45 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:45.870368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-871953fc-8cb1-46b8-9681-bd4b045bad6e req-4b91cfab-6281-4be6-a52f-d4417883e815 service nova] Creating event network-vif-deleted:bb2c34ca-6d45-4472-864f-42de8bae8411 for instance e896d6d6-dd30-46c4-a04f-e9225a22a58d on hv-cinder-78605 Apr 19 03:41:45.881001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-871953fc-8cb1-46b8-9681-bd4b045bad6e req-4b91cfab-6281-4be6-a52f-d4417883e815 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110047 Apr 19 03:41:45.882104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 259/551] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:41:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:41:46.170623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:46.171994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:46.184561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:46.185046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:46.186091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:46.186731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:46.373158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:46.373659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:46.374182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lazy-loading 'fault' on Instance uuid e896d6d6-dd30-46c4-a04f-e9225a22a58d {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:41:46.858461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fd423b06-5070-4d4b-aef1-4dd5edf3dd0d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:46.859322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fd423b06-5070-4d4b-aef1-4dd5edf3dd0d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:46.895093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7230efa31a8f47ca95af1f576f73cd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4502ef85b348a384aa26343b925024', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:46.896310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd423b06-5070-4d4b-aef1-4dd5edf3dd0d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:46.900834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd423b06-5070-4d4b-aef1-4dd5edf3dd0d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:46.901935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd423b06-5070-4d4b-aef1-4dd5edf3dd0d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:46.902594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd423b06-5070-4d4b-aef1-4dd5edf3dd0d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:46.910082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0b5fef6a-1e10-4715-b3b1-d69ba2478244 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 200 len: 1308 microversion: 2.1 time: 0.742030 Apr 19 03:41:46.910571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 293/552] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:46 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 1308 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:47.276045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fd423b06-5070-4d4b-aef1-4dd5edf3dd0d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:47.286118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fd423b06-5070-4d4b-aef1-4dd5edf3dd0d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:47.287846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fd423b06-5070-4d4b-aef1-4dd5edf3dd0d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:47.289764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fd423b06-5070-4d4b-aef1-4dd5edf3dd0d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1723 microversion: 2.20 time: 0.436821 Apr 19 03:41:47.293958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 260/553] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:46 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1723 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:47.928454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2412bae0-738c-4cfe-9d77-04f3ce8d1b13 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:47.929852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2412bae0-738c-4cfe-9d77-04f3ce8d1b13 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] [instance: e896d6d6-dd30-46c4-a04f-e9225a22a58d] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:47.938582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2412bae0-738c-4cfe-9d77-04f3ce8d1b13 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:47.939261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2412bae0-738c-4cfe-9d77-04f3ce8d1b13 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:47.940333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2412bae0-738c-4cfe-9d77-04f3ce8d1b13 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:47.941199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2412bae0-738c-4cfe-9d77-04f3ce8d1b13 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:48.007853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-2412bae0-738c-4cfe-9d77-04f3ce8d1b13 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] HTTP exception thrown: Instance e896d6d6-dd30-46c4-a04f-e9225a22a58d could not be found. Apr 19 03:41:48.008848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2412bae0-738c-4cfe-9d77-04f3ce8d1b13 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] Returning 404 to user: Instance e896d6d6-dd30-46c4-a04f-e9225a22a58d could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:48.009964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2412bae0-738c-4cfe-9d77-04f3ce8d1b13 tempest-AttachVolumeNegativeTest-1289625679 tempest-AttachVolumeNegativeTest-1289625679-project] 10.222.0.25 "GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d" status: 404 len: 111 microversion: 2.1 time: 0.085639 Apr 19 03:41:48.011120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 294/554] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:47 2021] GET /compute/v2.1/servers/e896d6d6-dd30-46c4-a04f-e9225a22a58d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:41:48.309918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0229310b-29bb-414a-be6b-d74397a4bd7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:48.310757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0229310b-29bb-414a-be6b-d74397a4bd7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:48.326227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0229310b-29bb-414a-be6b-d74397a4bd7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:48.326713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0229310b-29bb-414a-be6b-d74397a4bd7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:48.333008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0229310b-29bb-414a-be6b-d74397a4bd7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:48.333522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0229310b-29bb-414a-be6b-d74397a4bd7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:48.939221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0229310b-29bb-414a-be6b-d74397a4bd7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:48.949807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0229310b-29bb-414a-be6b-d74397a4bd7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:48.951513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0229310b-29bb-414a-be6b-d74397a4bd7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:48.953114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0229310b-29bb-414a-be6b-d74397a4bd7d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1723 microversion: 2.20 time: 0.646992 Apr 19 03:41:48.953991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 261/555] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:48 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1723 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:49.978211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-38c19336-662d-4412-9774-32109ea1fe1f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:49.978899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-38c19336-662d-4412-9774-32109ea1fe1f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:49.987296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38c19336-662d-4412-9774-32109ea1fe1f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:49.987809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38c19336-662d-4412-9774-32109ea1fe1f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:49.988817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38c19336-662d-4412-9774-32109ea1fe1f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:49.989314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38c19336-662d-4412-9774-32109ea1fe1f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:50.233296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-38c19336-662d-4412-9774-32109ea1fe1f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:50.246121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-38c19336-662d-4412-9774-32109ea1fe1f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:50.248290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-38c19336-662d-4412-9774-32109ea1fe1f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:50.250018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-38c19336-662d-4412-9774-32109ea1fe1f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1744 microversion: 2.20 time: 0.276391 Apr 19 03:41:50.262756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 295/556] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:49 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1744 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:51.269663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-40d972e9-6946-46ff-8381-3aeeba54f062 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:51.270427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-40d972e9-6946-46ff-8381-3aeeba54f062 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:51.288582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-40d972e9-6946-46ff-8381-3aeeba54f062 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:51.289315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-40d972e9-6946-46ff-8381-3aeeba54f062 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:51.291275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-40d972e9-6946-46ff-8381-3aeeba54f062 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:51.292267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-40d972e9-6946-46ff-8381-3aeeba54f062 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:51.531571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-40d972e9-6946-46ff-8381-3aeeba54f062 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:51.541172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-40d972e9-6946-46ff-8381-3aeeba54f062 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:51.542847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-40d972e9-6946-46ff-8381-3aeeba54f062 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:51.544084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-40d972e9-6946-46ff-8381-3aeeba54f062 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.279029 Apr 19 03:41:51.544694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 262/557] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:51 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:52.020223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-32728146-6059-4797-95aa-51a6d97b6955 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Action: 'create', calling method: .version_select at 0x7f9dac19db70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-707734676", "metadata": {"Type": "work"}}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:52.021861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-32728146-6059-4797-95aa-51a6d97b6955 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:52.022696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-32728146-6059-4797-95aa-51a6d97b6955 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136363 Apr 19 03:41:52.023451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 296/558] 10.222.0.25 () {60 vars in 1146 bytes} [Mon Apr 19 03:41:51 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 03:41:52.032861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5add8e6e-547f-424d-bd67-aa9ed456b4e4 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Action: 'create', calling method: .version_select at 0x7f9dac49af28>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1557567783", "metadata": {"Type": "work"}}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:52.034440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5add8e6e-547f-424d-bd67-aa9ed456b4e4 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:52.035401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5add8e6e-547f-424d-bd67-aa9ed456b4e4 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006571 Apr 19 03:41:52.036077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 297/559] 10.222.0.25 () {60 vars in 1146 bytes} [Mon Apr 19 03:41:52 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 19 03:41:52.045716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-47dff5c6-b419-41a5-9782-db31a1199366 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Action: 'create', calling method: .version_select at 0x7f9db106bf28>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-119859045", "metadata": {"Type": "work"}}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:52.046977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-47dff5c6-b419-41a5-9782-db31a1199366 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:52.048802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-47dff5c6-b419-41a5-9782-db31a1199366 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006611 Apr 19 03:41:52.049701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 298/560] 10.222.0.25 () {60 vars in 1146 bytes} [Mon Apr 19 03:41:52 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 19 03:41:52.059708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b979c91b-b3d9-44d0-89a7-085c5b430061 tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] Action: 'create', calling method: .version_select at 0x7f9dac337598>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-959604366", "metadata": {"Type": "work"}}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:52.072244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6e37eabe-d7f8-4bc8-8c13-a4a87252230d tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Calling method '.version_select at 0x7f9dac6c1950>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:52.193598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-6e37eabe-d7f8-4bc8-8c13-a4a87252230d tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] HTTP exception thrown: Volume tempest-invalid-643145898 could not be found. Apr 19 03:41:52.194252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6e37eabe-d7f8-4bc8-8c13-a4a87252230d tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Returning 404 to user: Volume tempest-invalid-643145898 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:52.195216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6e37eabe-d7f8-4bc8-8c13-a4a87252230d tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-643145898" status: 404 len: 98 microversion: 2.1 time: 0.126914 Apr 19 03:41:52.195853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 299/561] 10.222.0.25 () {58 vars in 1205 bytes} [Mon Apr 19 03:41:52 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-643145898 => generated 98 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 19 03:41:52.206179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3344717e-f4e3-479e-b7fd-168777d093b1 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004957 Apr 19 03:41:52.206697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 300/562] 10.222.0.25 () {58 vars in 1130 bytes} [Mon Apr 19 03:41:52 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 19 03:41:52.215583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-49ba9cd2-a87c-48ac-bc48-14eccc0205a8 tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003440 Apr 19 03:41:52.216105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 301/563] 10.222.0.25 () {58 vars in 1127 bytes} [Mon Apr 19 03:41:52 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 19 03:41:52.225681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-932e748d-1317-4659-9611-1017a017d74f tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Calling method '.version_select at 0x7f9dac49a1e0>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:52.307948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-932e748d-1317-4659-9611-1017a017d74f tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] HTTP exception thrown: Volume b7b3d1fc-d890-4c53-8c25-fdc8de812d2d could not be found. Apr 19 03:41:52.308581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-932e748d-1317-4659-9611-1017a017d74f tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Returning 404 to user: Volume b7b3d1fc-d890-4c53-8c25-fdc8de812d2d could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:52.309487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-932e748d-1317-4659-9611-1017a017d74f tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/b7b3d1fc-d890-4c53-8c25-fdc8de812d2d" status: 404 len: 109 microversion: 2.1 time: 0.088100 Apr 19 03:41:52.310074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 302/564] 10.222.0.25 () {58 vars in 1238 bytes} [Mon Apr 19 03:41:52 2021] DELETE /compute/v2.1/os-volumes/b7b3d1fc-d890-4c53-8c25-fdc8de812d2d => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:41:52.324134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7c26aaa-595e-41e2-b954-b7947537bbfc tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Calling method '.version_select at 0x7f9dad0061e0>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:52.401065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-b7c26aaa-595e-41e2-b954-b7947537bbfc tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] HTTP exception thrown: Volume 6a261bc3-4671-4d35-97c0-18b5ce7679a4 could not be found. Apr 19 03:41:52.401733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7c26aaa-595e-41e2-b954-b7947537bbfc tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] Returning 404 to user: Volume 6a261bc3-4671-4d35-97c0-18b5ce7679a4 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:52.402637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b7c26aaa-595e-41e2-b954-b7947537bbfc tempest-VolumesNegativeTest-37177258 tempest-VolumesNegativeTest-37177258-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6a261bc3-4671-4d35-97c0-18b5ce7679a4" status: 404 len: 109 microversion: 2.1 time: 0.082684 Apr 19 03:41:52.403374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 303/565] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:41:52 2021] GET /compute/v2.1/os-volumes/6a261bc3-4671-4d35-97c0-18b5ce7679a4 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 03:41:52.516943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-5c5cafea-581c-4464-aa73-083677bc7ee4 req-0460e44f-a03f-4826-89bd-54c7bff26bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29b14f0-f43c-434b-b583-cdf6b0e4b784", "name": "network-vif-plugged", "status": "completed", "tag": "8b1a69d0-ba1e-4994-b669-cc0e63d13b8b"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:52.519819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:41:52.519819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:41:52.533480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-5c5cafea-581c-4464-aa73-083677bc7ee4 req-0460e44f-a03f-4826-89bd-54c7bff26bd3 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:52.533480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-5c5cafea-581c-4464-aa73-083677bc7ee4 req-0460e44f-a03f-4826-89bd-54c7bff26bd3 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:52.563599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-5c5cafea-581c-4464-aa73-083677bc7ee4 req-0460e44f-a03f-4826-89bd-54c7bff26bd3 service nova] Creating event network-vif-plugged:8b1a69d0-ba1e-4994-b669-cc0e63d13b8b for instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 on hv-cinder-78605 Apr 19 03:41:52.569263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-5c5cafea-581c-4464-aa73-083677bc7ee4 req-0460e44f-a03f-4826-89bd-54c7bff26bd3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059821 Apr 19 03:41:52.571435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 304/566] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:41:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:41:52.578282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3a75d73f-9b99-4cad-a560-f3f6dbd4a4d6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:52.579398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3a75d73f-9b99-4cad-a560-f3f6dbd4a4d6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:52.588570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a75d73f-9b99-4cad-a560-f3f6dbd4a4d6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:52.589116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a75d73f-9b99-4cad-a560-f3f6dbd4a4d6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:52.589968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a75d73f-9b99-4cad-a560-f3f6dbd4a4d6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:52.590459 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a75d73f-9b99-4cad-a560-f3f6dbd4a4d6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:52.747413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b979c91b-b3d9-44d0-89a7-085c5b430061 tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.829127 Apr 19 03:41:52.750214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 263/567] 10.222.0.25 () {60 vars in 1146 bytes} [Mon Apr 19 03:41:51 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 832 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 19 03:41:52.761866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-67d7c251-aa0d-4aa0-931c-f5cdc8c2eb60 tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] Calling method '.version_select at 0x7f9db106bf28>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:52.894173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3a75d73f-9b99-4cad-a560-f3f6dbd4a4d6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:52.903959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3a75d73f-9b99-4cad-a560-f3f6dbd4a4d6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:52.905632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3a75d73f-9b99-4cad-a560-f3f6dbd4a4d6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:52.906844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3a75d73f-9b99-4cad-a560-f3f6dbd4a4d6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.334081 Apr 19 03:41:52.907465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 305/568] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:52 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:52.914491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-67d7c251-aa0d-4aa0-931c-f5cdc8c2eb60 tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839" status: 200 len: 352 microversion: 2.1 time: 0.154907 Apr 19 03:41:52.914491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 264/569] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:41:52 2021] GET /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839 => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:41:53.466880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6094f64d-4902-446a-b241-dc81bcb2035a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:53.467634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6094f64d-4902-446a-b241-dc81bcb2035a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:53.476616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6094f64d-4902-446a-b241-dc81bcb2035a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:53.477118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6094f64d-4902-446a-b241-dc81bcb2035a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:53.477992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6094f64d-4902-446a-b241-dc81bcb2035a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:53.478477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6094f64d-4902-446a-b241-dc81bcb2035a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:53.661628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-6094f64d-4902-446a-b241-dc81bcb2035a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lazy-loading 'services' on Instance uuid 8953516a-dcec-4e76-92a9-9a8f25e24014 {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:41:53.871184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6094f64d-4902-446a-b241-dc81bcb2035a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/os-volume_attachments/39d3de1a-3f58-4817-9c4e-9045f18a5f6a" status: 202 len: 0 microversion: 2.1 time: 0.408161 Apr 19 03:41:53.871937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 265/570] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:41:53 2021] DELETE /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/os-volume_attachments/39d3de1a-3f58-4817-9c4e-9045f18a5f6a => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:53.929604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4f2d4fb0-f802-4221-ab81-b6f7317e94c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:53.930873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4f2d4fb0-f802-4221-ab81-b6f7317e94c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:53.946388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2113c59a-cb69-46a1-a877-8e110b9f31e3 tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] Calling method '.version_select at 0x7f9dac49ab70>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:53.957465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f2d4fb0-f802-4221-ab81-b6f7317e94c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:53.958250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f2d4fb0-f802-4221-ab81-b6f7317e94c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:53.959296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f2d4fb0-f802-4221-ab81-b6f7317e94c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:53.960075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f2d4fb0-f802-4221-ab81-b6f7317e94c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:54.106216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2113c59a-cb69-46a1-a877-8e110b9f31e3 tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839" status: 200 len: 353 microversion: 2.1 time: 0.185260 Apr 19 03:41:54.107118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 306/571] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:41:53 2021] GET /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839 => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:41:54.120161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a6590772-e895-4476-ae76-4897be9f31ab tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] Calling method '.version_select at 0x7f9dac49a378>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:54.222793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a6590772-e895-4476-ae76-4897be9f31ab tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839" status: 200 len: 353 microversion: 2.1 time: 0.107647 Apr 19 03:41:54.223739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 307/572] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:41:54 2021] GET /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:41:54.245598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c5be6051-2e41-45cf-adc6-e04891557d1b tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] Calling method '.version_select at 0x7f9dac58e400>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:54.248941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4f2d4fb0-f802-4221-ab81-b6f7317e94c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:54.260646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4f2d4fb0-f802-4221-ab81-b6f7317e94c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:54.263860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4f2d4fb0-f802-4221-ab81-b6f7317e94c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:54.266085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4f2d4fb0-f802-4221-ab81-b6f7317e94c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.343435 Apr 19 03:41:54.267473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 266/573] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:53 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:54.445368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c5be6051-2e41-45cf-adc6-e04891557d1b tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839" status: 202 len: 0 microversion: 2.1 time: 0.204524 Apr 19 03:41:54.448961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 308/574] 10.222.0.25 () {58 vars in 1238 bytes} [Mon Apr 19 03:41:54 2021] DELETE /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:41:54.455361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6d0a4c13-0b46-4142-b24a-607fe1ee7300 tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] Calling method '.version_select at 0x7f9dac5ceae8>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:54.565387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6d0a4c13-0b46-4142-b24a-607fe1ee7300 tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839" status: 200 len: 352 microversion: 2.1 time: 0.113552 Apr 19 03:41:54.571705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 267/575] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:41:54 2021] GET /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839 => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:41:55.130992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-979750cb-3d89-4a8b-bc87-a6af9b3b7f29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:41:55.139830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-979750cb-3d89-4a8b-bc87-a6af9b3b7f29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:55.140387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-979750cb-3d89-4a8b-bc87-a6af9b3b7f29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:55.220857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-979750cb-3d89-4a8b-bc87-a6af9b3b7f29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Going to try to stop instance {{(pid=100591) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 19 03:41:55.286283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e8fd85cd-d3f3-46b1-b2ad-ef158ec24060 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:55.286942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e8fd85cd-d3f3-46b1-b2ad-ef158ec24060 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:55.294907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8fd85cd-d3f3-46b1-b2ad-ef158ec24060 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:55.295469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8fd85cd-d3f3-46b1-b2ad-ef158ec24060 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:55.296296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8fd85cd-d3f3-46b1-b2ad-ef158ec24060 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:55.296785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8fd85cd-d3f3-46b1-b2ad-ef158ec24060 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:55.358535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-979750cb-3d89-4a8b-bc87-a6af9b3b7f29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 202 len: 0 microversion: 2.1 time: 0.231322 Apr 19 03:41:55.359093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 309/576] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:41:55 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:41:55.370234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-65ec442c-43f3-4d46-827e-ad0b3604a032 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:55.371975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-65ec442c-43f3-4d46-827e-ad0b3604a032 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:55.383228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65ec442c-43f3-4d46-827e-ad0b3604a032 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:55.383750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65ec442c-43f3-4d46-827e-ad0b3604a032 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:55.385944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65ec442c-43f3-4d46-827e-ad0b3604a032 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:55.385944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65ec442c-43f3-4d46-827e-ad0b3604a032 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:55.621305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-65ec442c-43f3-4d46-827e-ad0b3604a032 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:55.630476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-65ec442c-43f3-4d46-827e-ad0b3604a032 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1676 microversion: 2.1 time: 0.266332 Apr 19 03:41:55.631579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 310/577] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:55 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1676 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:55.636397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ddb9b231-a710-4fec-9f3d-f8daca8e272b tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] Calling method '.version_select at 0x7f9dac19db70>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:55.652646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e8fd85cd-d3f3-46b1-b2ad-ef158ec24060 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:55.662626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e8fd85cd-d3f3-46b1-b2ad-ef158ec24060 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:55.664862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e8fd85cd-d3f3-46b1-b2ad-ef158ec24060 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:55.666083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e8fd85cd-d3f3-46b1-b2ad-ef158ec24060 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.383994 Apr 19 03:41:55.666798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 268/578] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:55 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:41:55.705610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-ddb9b231-a710-4fec-9f3d-f8daca8e272b tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] HTTP exception thrown: Volume 0869ecbe-db64-4d1d-9d39-c3a385b71839 could not be found. Apr 19 03:41:55.706366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ddb9b231-a710-4fec-9f3d-f8daca8e272b tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] Returning 404 to user: Volume 0869ecbe-db64-4d1d-9d39-c3a385b71839 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:41:55.707314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ddb9b231-a710-4fec-9f3d-f8daca8e272b tempest-VolumesGetTestJSON-2010111511 tempest-VolumesGetTestJSON-2010111511-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839" status: 404 len: 109 microversion: 2.1 time: 0.074855 Apr 19 03:41:55.707920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 311/579] 10.222.0.25 () {58 vars in 1235 bytes} [Mon Apr 19 03:41:55 2021] GET /compute/v2.1/os-volumes/0869ecbe-db64-4d1d-9d39-c3a385b71839 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:41:56.649111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-91c2ef43-043b-4499-af5e-3fa7d517ed6f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:56.649917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-91c2ef43-043b-4499-af5e-3fa7d517ed6f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:56.657852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91c2ef43-043b-4499-af5e-3fa7d517ed6f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:56.658360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91c2ef43-043b-4499-af5e-3fa7d517ed6f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:56.659229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91c2ef43-043b-4499-af5e-3fa7d517ed6f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:56.659740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91c2ef43-043b-4499-af5e-3fa7d517ed6f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:56.685929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9e0516b0-3b48-47b4-8ac2-2b1ad31edcf6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:56.686787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9e0516b0-3b48-47b4-8ac2-2b1ad31edcf6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:56.700517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e0516b0-3b48-47b4-8ac2-2b1ad31edcf6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:56.703359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e0516b0-3b48-47b4-8ac2-2b1ad31edcf6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:56.704227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e0516b0-3b48-47b4-8ac2-2b1ad31edcf6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:56.704726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e0516b0-3b48-47b4-8ac2-2b1ad31edcf6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:56.996759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9e0516b0-3b48-47b4-8ac2-2b1ad31edcf6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:57.003192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-91c2ef43-043b-4499-af5e-3fa7d517ed6f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:57.006831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9e0516b0-3b48-47b4-8ac2-2b1ad31edcf6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:57.008871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9e0516b0-3b48-47b4-8ac2-2b1ad31edcf6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:57.010456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9e0516b0-3b48-47b4-8ac2-2b1ad31edcf6 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.328586 Apr 19 03:41:57.011205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 312/580] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:56 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:57.017832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-91c2ef43-043b-4499-af5e-3fa7d517ed6f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1676 microversion: 2.1 time: 0.367300 Apr 19 03:41:57.017832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 269/581] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:56 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1676 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:58.035021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-44f655cb-fd69-47ce-9271-ff33a5c6a2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:58.035719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-44f655cb-fd69-47ce-9271-ff33a5c6a2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:58.041100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6360c3ea-d307-4066-a6a5-c1c22507546a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:58.041775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6360c3ea-d307-4066-a6a5-c1c22507546a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:58.058715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44f655cb-fd69-47ce-9271-ff33a5c6a2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:58.059526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44f655cb-fd69-47ce-9271-ff33a5c6a2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:58.060714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44f655cb-fd69-47ce-9271-ff33a5c6a2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:58.061404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44f655cb-fd69-47ce-9271-ff33a5c6a2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:58.064779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6360c3ea-d307-4066-a6a5-c1c22507546a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:58.065285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6360c3ea-d307-4066-a6a5-c1c22507546a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:58.066132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6360c3ea-d307-4066-a6a5-c1c22507546a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:58.066619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6360c3ea-d307-4066-a6a5-c1c22507546a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:58.357882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-44f655cb-fd69-47ce-9271-ff33a5c6a2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:58.368341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-44f655cb-fd69-47ce-9271-ff33a5c6a2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1676 microversion: 2.1 time: 0.337801 Apr 19 03:41:58.369561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 313/582] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:58 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1676 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:41:58.544257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6360c3ea-d307-4066-a6a5-c1c22507546a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:58.580591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6360c3ea-d307-4066-a6a5-c1c22507546a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:58.584442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6360c3ea-d307-4066-a6a5-c1c22507546a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:41:58.591986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6360c3ea-d307-4066-a6a5-c1c22507546a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.565846 Apr 19 03:41:58.595512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 270/583] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:58 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:41:59.387222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8ba536ef-cd8e-45d5-8d54-03ba443da218 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:59.388563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8ba536ef-cd8e-45d5-8d54-03ba443da218 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:59.397403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ba536ef-cd8e-45d5-8d54-03ba443da218 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:59.398852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ba536ef-cd8e-45d5-8d54-03ba443da218 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:59.399944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ba536ef-cd8e-45d5-8d54-03ba443da218 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:59.400635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ba536ef-cd8e-45d5-8d54-03ba443da218 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:59.617076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-71564bd0-b7de-4b05-bc7f-e07260feef3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:41:59.618614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-71564bd0-b7de-4b05-bc7f-e07260feef3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:41:59.655316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71564bd0-b7de-4b05-bc7f-e07260feef3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:59.656047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71564bd0-b7de-4b05-bc7f-e07260feef3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:41:59.657265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71564bd0-b7de-4b05-bc7f-e07260feef3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:41:59.657872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71564bd0-b7de-4b05-bc7f-e07260feef3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:00.489513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8ba536ef-cd8e-45d5-8d54-03ba443da218 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:00.489513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8ba536ef-cd8e-45d5-8d54-03ba443da218 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1676 microversion: 2.1 time: 0.492270 Apr 19 03:42:00.489513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 314/584] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:41:59 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1676 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:00.490389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-71564bd0-b7de-4b05-bc7f-e07260feef3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:00.490389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-71564bd0-b7de-4b05-bc7f-e07260feef3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:00.490607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-71564bd0-b7de-4b05-bc7f-e07260feef3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:00.490607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-71564bd0-b7de-4b05-bc7f-e07260feef3c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.521644 Apr 19 03:42:00.490607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 271/585] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:41:59 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:01.339595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5afa6690-f278-41e0-99cf-1d7c71bb9a3b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:01.339595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5afa6690-f278-41e0-99cf-1d7c71bb9a3b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:01.340509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-844ec7a1-80c7-4610-b5f9-53a2faeb9574 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:01.340509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-844ec7a1-80c7-4610-b5f9-53a2faeb9574 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:01.340708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5afa6690-f278-41e0-99cf-1d7c71bb9a3b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:01.340708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5afa6690-f278-41e0-99cf-1d7c71bb9a3b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:01.340708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5afa6690-f278-41e0-99cf-1d7c71bb9a3b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:01.340708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5afa6690-f278-41e0-99cf-1d7c71bb9a3b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:01.341084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-844ec7a1-80c7-4610-b5f9-53a2faeb9574 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:01.341084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-844ec7a1-80c7-4610-b5f9-53a2faeb9574 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:01.341084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-844ec7a1-80c7-4610-b5f9-53a2faeb9574 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:01.341084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-844ec7a1-80c7-4610-b5f9-53a2faeb9574 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:01.467132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-844ec7a1-80c7-4610-b5f9-53a2faeb9574 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:01.477491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-844ec7a1-80c7-4610-b5f9-53a2faeb9574 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:01.479234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-844ec7a1-80c7-4610-b5f9-53a2faeb9574 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:01.480497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-844ec7a1-80c7-4610-b5f9-53a2faeb9574 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.286516 Apr 19 03:42:01.481124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 272/586] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:01 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:42:02.063076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5afa6690-f278-41e0-99cf-1d7c71bb9a3b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:02.073802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5afa6690-f278-41e0-99cf-1d7c71bb9a3b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1676 microversion: 2.1 time: 0.885390 Apr 19 03:42:02.076983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 315/587] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:01 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1676 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:02.500697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8bc0e5c9-d293-4e62-9a82-ef3d017592cc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:02.501701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8bc0e5c9-d293-4e62-9a82-ef3d017592cc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:02.513424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bc0e5c9-d293-4e62-9a82-ef3d017592cc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:02.514138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bc0e5c9-d293-4e62-9a82-ef3d017592cc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:02.515219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bc0e5c9-d293-4e62-9a82-ef3d017592cc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:02.516163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bc0e5c9-d293-4e62-9a82-ef3d017592cc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:02.929182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8bc0e5c9-d293-4e62-9a82-ef3d017592cc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:02.941554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8bc0e5c9-d293-4e62-9a82-ef3d017592cc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:02.943601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8bc0e5c9-d293-4e62-9a82-ef3d017592cc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:02.945632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8bc0e5c9-d293-4e62-9a82-ef3d017592cc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.449125 Apr 19 03:42:02.948861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 273/588] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:02 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:03.094112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-30041951-4d29-4c92-9d14-afa693e09ba9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:03.094769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-30041951-4d29-4c92-9d14-afa693e09ba9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:03.106373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30041951-4d29-4c92-9d14-afa693e09ba9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:03.115165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30041951-4d29-4c92-9d14-afa693e09ba9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:03.119686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30041951-4d29-4c92-9d14-afa693e09ba9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:03.119686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30041951-4d29-4c92-9d14-afa693e09ba9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:03.513074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-30041951-4d29-4c92-9d14-afa693e09ba9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:03.531957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-30041951-4d29-4c92-9d14-afa693e09ba9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1676 microversion: 2.1 time: 0.442555 Apr 19 03:42:03.542806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 316/589] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:03 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1676 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:03.969669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-217892e9-4f5b-4cd1-b658-bfd16d425779 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:03.969669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-217892e9-4f5b-4cd1-b658-bfd16d425779 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:03.983987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-217892e9-4f5b-4cd1-b658-bfd16d425779 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:03.984492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-217892e9-4f5b-4cd1-b658-bfd16d425779 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:03.985339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-217892e9-4f5b-4cd1-b658-bfd16d425779 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:03.985829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-217892e9-4f5b-4cd1-b658-bfd16d425779 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:04.427449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-217892e9-4f5b-4cd1-b658-bfd16d425779 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:04.441531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-217892e9-4f5b-4cd1-b658-bfd16d425779 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:04.444891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-217892e9-4f5b-4cd1-b658-bfd16d425779 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:04.447136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-217892e9-4f5b-4cd1-b658-bfd16d425779 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.482945 Apr 19 03:42:04.447983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 274/590] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:03 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:04.550436 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ff1e98e3-46d9-404e-92ba-f83d299c535a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:04.551656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ff1e98e3-46d9-404e-92ba-f83d299c535a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:04.570818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff1e98e3-46d9-404e-92ba-f83d299c535a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:04.575924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff1e98e3-46d9-404e-92ba-f83d299c535a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:04.575924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff1e98e3-46d9-404e-92ba-f83d299c535a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:04.575924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff1e98e3-46d9-404e-92ba-f83d299c535a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:04.836062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ff1e98e3-46d9-404e-92ba-f83d299c535a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:04.845354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ff1e98e3-46d9-404e-92ba-f83d299c535a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1676 microversion: 2.1 time: 0.299250 Apr 19 03:42:04.846023 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 317/591] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:04 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1676 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:05.467551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ba59c9f1-1a52-4bda-8bc8-b679dd2d1766 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:05.468879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ba59c9f1-1a52-4bda-8bc8-b679dd2d1766 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:05.480958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba59c9f1-1a52-4bda-8bc8-b679dd2d1766 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:05.481733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba59c9f1-1a52-4bda-8bc8-b679dd2d1766 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:05.482758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba59c9f1-1a52-4bda-8bc8-b679dd2d1766 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:05.483253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba59c9f1-1a52-4bda-8bc8-b679dd2d1766 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:05.738835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ba59c9f1-1a52-4bda-8bc8-b679dd2d1766 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:05.749864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ba59c9f1-1a52-4bda-8bc8-b679dd2d1766 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:05.751727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ba59c9f1-1a52-4bda-8bc8-b679dd2d1766 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:05.753246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ba59c9f1-1a52-4bda-8bc8-b679dd2d1766 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.290141 Apr 19 03:42:05.754324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 275/592] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:05 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:05.868153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8cb1b78f-4f3b-445d-b3b0-5369c30f114e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:05.868826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8cb1b78f-4f3b-445d-b3b0-5369c30f114e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:05.876730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8cb1b78f-4f3b-445d-b3b0-5369c30f114e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:05.877222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8cb1b78f-4f3b-445d-b3b0-5369c30f114e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:05.878246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8cb1b78f-4f3b-445d-b3b0-5369c30f114e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:05.878892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8cb1b78f-4f3b-445d-b3b0-5369c30f114e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:06.123483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8cb1b78f-4f3b-445d-b3b0-5369c30f114e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:06.134486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8cb1b78f-4f3b-445d-b3b0-5369c30f114e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1676 microversion: 2.1 time: 0.270278 Apr 19 03:42:06.135341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 318/593] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:05 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1676 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:06.774168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-be420c94-6dcf-434f-aaaa-eca875826c92 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:06.774836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-be420c94-6dcf-434f-aaaa-eca875826c92 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:06.786008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be420c94-6dcf-434f-aaaa-eca875826c92 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:06.786777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be420c94-6dcf-434f-aaaa-eca875826c92 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:06.787632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be420c94-6dcf-434f-aaaa-eca875826c92 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:06.788339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be420c94-6dcf-434f-aaaa-eca875826c92 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:07.068476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-be420c94-6dcf-434f-aaaa-eca875826c92 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:07.082456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-be420c94-6dcf-434f-aaaa-eca875826c92 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:07.083301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-be420c94-6dcf-434f-aaaa-eca875826c92 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:07.084546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-be420c94-6dcf-434f-aaaa-eca875826c92 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.315161 Apr 19 03:42:07.085784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 276/594] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:06 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:07.160716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cec283e5-0bc2-4118-8312-95e539779e07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:07.161508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cec283e5-0bc2-4118-8312-95e539779e07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:07.177695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cec283e5-0bc2-4118-8312-95e539779e07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:07.178296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cec283e5-0bc2-4118-8312-95e539779e07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:07.180133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cec283e5-0bc2-4118-8312-95e539779e07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:07.180865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cec283e5-0bc2-4118-8312-95e539779e07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:07.454390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cec283e5-0bc2-4118-8312-95e539779e07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:07.480097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cec283e5-0bc2-4118-8312-95e539779e07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1676 microversion: 2.1 time: 0.331007 Apr 19 03:42:07.491452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 319/595] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:07 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1676 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:08.110885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e06ea561-5a33-42e5-b45a-f54dce08262a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:08.113492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e06ea561-5a33-42e5-b45a-f54dce08262a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:08.126221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e06ea561-5a33-42e5-b45a-f54dce08262a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:08.126728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e06ea561-5a33-42e5-b45a-f54dce08262a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:08.127582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e06ea561-5a33-42e5-b45a-f54dce08262a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:08.134344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e06ea561-5a33-42e5-b45a-f54dce08262a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:08.481479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e06ea561-5a33-42e5-b45a-f54dce08262a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:08.494091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e06ea561-5a33-42e5-b45a-f54dce08262a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:08.496383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e06ea561-5a33-42e5-b45a-f54dce08262a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:08.497778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e06ea561-5a33-42e5-b45a-f54dce08262a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.391289 Apr 19 03:42:08.498481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 277/596] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:08 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:08.500699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-76640a10-d163-4889-9357-470ebe23bc5a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:08.501405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-76640a10-d163-4889-9357-470ebe23bc5a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:08.511161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76640a10-d163-4889-9357-470ebe23bc5a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:08.511661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76640a10-d163-4889-9357-470ebe23bc5a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:08.512879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76640a10-d163-4889-9357-470ebe23bc5a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:08.513546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76640a10-d163-4889-9357-470ebe23bc5a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:08.794402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-76640a10-d163-4889-9357-470ebe23bc5a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:08.803971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-76640a10-d163-4889-9357-470ebe23bc5a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1653 microversion: 2.1 time: 0.309190 Apr 19 03:42:08.804701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 320/597] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:08 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1653 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:08.822203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-61c35604-1b1d-40c0-8dff-8dcf1a5c61da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:08.830274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-61c35604-1b1d-40c0-8dff-8dcf1a5c61da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:08.830783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-61c35604-1b1d-40c0-8dff-8dcf1a5c61da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:08.891518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-61c35604-1b1d-40c0-8dff-8dcf1a5c61da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Going to try to start instance {{(pid=100590) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 19 03:42:09.133704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-61c35604-1b1d-40c0-8dff-8dcf1a5c61da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action" status: 202 len: 0 microversion: 2.1 time: 0.312515 Apr 19 03:42:09.133704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 278/598] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:42:08 2021] POST /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:42:09.140277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cec2aa24-8d8e-4ec8-9937-f684ba14b79d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:09.143283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cec2aa24-8d8e-4ec8-9937-f684ba14b79d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:09.149314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cec2aa24-8d8e-4ec8-9937-f684ba14b79d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:09.149905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cec2aa24-8d8e-4ec8-9937-f684ba14b79d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:09.150864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cec2aa24-8d8e-4ec8-9937-f684ba14b79d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:09.151551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cec2aa24-8d8e-4ec8-9937-f684ba14b79d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:09.497248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cec2aa24-8d8e-4ec8-9937-f684ba14b79d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:09.507334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cec2aa24-8d8e-4ec8-9937-f684ba14b79d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1662 microversion: 2.1 time: 0.371272 Apr 19 03:42:09.508642 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 321/599] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:09 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1662 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:09.518690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-880662dc-21f2-4a37-8c32-c4118841747c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:09.519701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-880662dc-21f2-4a37-8c32-c4118841747c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:09.543758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-880662dc-21f2-4a37-8c32-c4118841747c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:09.547648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-880662dc-21f2-4a37-8c32-c4118841747c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:09.548795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-880662dc-21f2-4a37-8c32-c4118841747c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:09.549509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-880662dc-21f2-4a37-8c32-c4118841747c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:09.780941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-781608536", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-785891168", "security_groups": [{"name": "tempest-secgroup-smoke-2104745756"}], "block_device_mapping_v2": [{"uuid": "5655f5d4-c54a-4a2d-a79e-a02833887977", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa5df436-235a-45f0-896c-3f8b6fe17aeb"}]}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:09.982995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] validate_networks() for [('aa5df436-235a-45f0-896c-3f8b6fe17aeb', None, None, None)] {{(pid=100591) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:42:09.984295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-880662dc-21f2-4a37-8c32-c4118841747c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:09.997972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-880662dc-21f2-4a37-8c32-c4118841747c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:09.999863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-880662dc-21f2-4a37-8c32-c4118841747c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:10.001088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-880662dc-21f2-4a37-8c32-c4118841747c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.486984 Apr 19 03:42:10.001997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 279/600] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:09 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:10.526059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f31093a4-c384-4d0e-bcad-d909ca5415a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:10.526687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f31093a4-c384-4d0e-bcad-d909ca5415a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:10.534648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f31093a4-c384-4d0e-bcad-d909ca5415a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:10.535162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f31093a4-c384-4d0e-bcad-d909ca5415a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:10.535990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f31093a4-c384-4d0e-bcad-d909ca5415a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:10.536640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f31093a4-c384-4d0e-bcad-d909ca5415a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:10.646122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Flavor limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:42:10.646817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Image limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:42:10.647540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Flavor pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:42:10.648024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Image pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:42:10.648508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:42:10.657914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:10.658424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:10.659355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:10.659854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:10.679372 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Getting quotas for project a012a767fda74dde8c60610167f3a08a. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:42:10.683693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Getting quotas for user 0e8af417bbfa4deda2c64b88a8d5c6ed and project a012a767fda74dde8c60610167f3a08a. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:42:10.759424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f31093a4-c384-4d0e-bcad-d909ca5415a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:10.772111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f31093a4-c384-4d0e-bcad-d909ca5415a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1662 microversion: 2.1 time: 0.250169 Apr 19 03:42:10.772741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 280/601] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:10 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1662 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:42:10.793630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Going to run 1 instances... {{(pid=100591) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:42:10.801979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5655f5d4-c54a-4a2d-a79e-a02833887977',volume_size=None,volume_type=None)] {{(pid=100591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:42:11.021196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e55699ae-f730-4763-bd33-c8fc7dca6ae7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:11.021861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e55699ae-f730-4763-bd33-c8fc7dca6ae7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:11.030214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e55699ae-f730-4763-bd33-c8fc7dca6ae7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:11.030715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e55699ae-f730-4763-bd33-c8fc7dca6ae7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:11.031564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e55699ae-f730-4763-bd33-c8fc7dca6ae7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:11.032051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e55699ae-f730-4763-bd33-c8fc7dca6ae7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:11.099354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c43c743c-377e-4139-a6da-85dd67fad9f1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.322448 Apr 19 03:42:11.100256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 322/602] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:42:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:42:11.111118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9d57eb94-007c-462c-9d46-e599137524ee tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:11.112071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9d57eb94-007c-462c-9d46-e599137524ee tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:11.196680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9d57eb94-007c-462c-9d46-e599137524ee tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:11.206072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9d57eb94-007c-462c-9d46-e599137524ee tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1093 microversion: 2.1 time: 0.098813 Apr 19 03:42:11.206719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 323/603] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:11 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1093 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:42:11.252213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e55699ae-f730-4763-bd33-c8fc7dca6ae7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:11.262086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e55699ae-f730-4763-bd33-c8fc7dca6ae7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:11.263788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e55699ae-f730-4763-bd33-c8fc7dca6ae7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:11.265040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e55699ae-f730-4763-bd33-c8fc7dca6ae7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.247971 Apr 19 03:42:11.265645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 281/604] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:11 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:42:11.790987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-40a182d4-b763-4ac6-92a9-442d9d332b83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:11.791692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-40a182d4-b763-4ac6-92a9-442d9d332b83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:11.799775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-40a182d4-b763-4ac6-92a9-442d9d332b83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:11.800287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-40a182d4-b763-4ac6-92a9-442d9d332b83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:11.801115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-40a182d4-b763-4ac6-92a9-442d9d332b83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:11.801606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-40a182d4-b763-4ac6-92a9-442d9d332b83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:12.018411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-40a182d4-b763-4ac6-92a9-442d9d332b83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:12.027974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-40a182d4-b763-4ac6-92a9-442d9d332b83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1662 microversion: 2.1 time: 0.241330 Apr 19 03:42:12.028606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 324/605] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:11 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1662 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:12.224475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-903cce3d-6b60-4c9e-a66d-89016102b207 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:12.225640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-903cce3d-6b60-4c9e-a66d-89016102b207 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:12.285400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9a5abca4-0444-46fe-a794-bf60a99768d4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:12.286069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9a5abca4-0444-46fe-a794-bf60a99768d4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:12.294588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a5abca4-0444-46fe-a794-bf60a99768d4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:12.295131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a5abca4-0444-46fe-a794-bf60a99768d4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:12.295984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a5abca4-0444-46fe-a794-bf60a99768d4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:12.296467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a5abca4-0444-46fe-a794-bf60a99768d4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:12.363206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-903cce3d-6b60-4c9e-a66d-89016102b207 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:12.372316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-903cce3d-6b60-4c9e-a66d-89016102b207 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1093 microversion: 2.1 time: 0.151572 Apr 19 03:42:12.373192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 282/606] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:12 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1093 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:12.519578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9a5abca4-0444-46fe-a794-bf60a99768d4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:12.529596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9a5abca4-0444-46fe-a794-bf60a99768d4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:12.531337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9a5abca4-0444-46fe-a794-bf60a99768d4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:12.532557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9a5abca4-0444-46fe-a794-bf60a99768d4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.251539 Apr 19 03:42:12.533164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 325/607] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:12 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:42:13.045872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5f46af18-c7c7-45b1-b115-28fbdbf7c4cd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:13.046547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5f46af18-c7c7-45b1-b115-28fbdbf7c4cd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:13.054849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f46af18-c7c7-45b1-b115-28fbdbf7c4cd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:13.055386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f46af18-c7c7-45b1-b115-28fbdbf7c4cd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:13.056219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f46af18-c7c7-45b1-b115-28fbdbf7c4cd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:13.056709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f46af18-c7c7-45b1-b115-28fbdbf7c4cd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:13.277335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5f46af18-c7c7-45b1-b115-28fbdbf7c4cd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:13.286485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5f46af18-c7c7-45b1-b115-28fbdbf7c4cd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1662 microversion: 2.1 time: 0.244579 Apr 19 03:42:13.287093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 283/608] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:13 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1662 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:13.390820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a9366a06-3fb2-4cb8-a105-4296dd7ff6a4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:13.391743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a9366a06-3fb2-4cb8-a105-4296dd7ff6a4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:13.473216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a9366a06-3fb2-4cb8-a105-4296dd7ff6a4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:13.481648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a9366a06-3fb2-4cb8-a105-4296dd7ff6a4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1093 microversion: 2.1 time: 0.094976 Apr 19 03:42:13.482269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 326/609] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:13 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1093 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:13.552971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-66135b70-e10d-4c15-a127-970e48a72275 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:13.554301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-66135b70-e10d-4c15-a127-970e48a72275 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:13.567249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66135b70-e10d-4c15-a127-970e48a72275 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:13.567842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66135b70-e10d-4c15-a127-970e48a72275 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:13.568812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66135b70-e10d-4c15-a127-970e48a72275 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:13.569456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66135b70-e10d-4c15-a127-970e48a72275 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:13.871559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-66135b70-e10d-4c15-a127-970e48a72275 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:13.881330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-66135b70-e10d-4c15-a127-970e48a72275 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:13.883002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-66135b70-e10d-4c15-a127-970e48a72275 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:13.884453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-66135b70-e10d-4c15-a127-970e48a72275 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1739 microversion: 2.20 time: 0.335661 Apr 19 03:42:13.885209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 284/610] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:13 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:14.304594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7932fd89-1470-48bb-94e4-44cc4d3931ac tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:14.305265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7932fd89-1470-48bb-94e4-44cc4d3931ac tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:14.314191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7932fd89-1470-48bb-94e4-44cc4d3931ac tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:14.314695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7932fd89-1470-48bb-94e4-44cc4d3931ac tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:14.315564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7932fd89-1470-48bb-94e4-44cc4d3931ac tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:14.316057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7932fd89-1470-48bb-94e4-44cc4d3931ac tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:14.501894 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9aff12cd-1c66-46d2-b0a1-61c1ff2b993f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:14.502577 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9aff12cd-1c66-46d2-b0a1-61c1ff2b993f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:14.544687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7932fd89-1470-48bb-94e4-44cc4d3931ac tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:14.570174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7932fd89-1470-48bb-94e4-44cc4d3931ac tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1662 microversion: 2.1 time: 0.269623 Apr 19 03:42:14.590580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 327/611] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:14 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1662 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:14.611899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9aff12cd-1c66-46d2-b0a1-61c1ff2b993f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:14.622078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9aff12cd-1c66-46d2-b0a1-61c1ff2b993f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1093 microversion: 2.1 time: 0.125778 Apr 19 03:42:14.623291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 285/612] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:14 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1093 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:14.904781 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ea4e259e-1f47-4671-ae8a-50fbb04b7289 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:14.905447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ea4e259e-1f47-4671-ae8a-50fbb04b7289 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:14.914280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea4e259e-1f47-4671-ae8a-50fbb04b7289 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:14.914796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea4e259e-1f47-4671-ae8a-50fbb04b7289 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:14.915676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea4e259e-1f47-4671-ae8a-50fbb04b7289 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:14.916182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea4e259e-1f47-4671-ae8a-50fbb04b7289 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:15.161273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea4e259e-1f47-4671-ae8a-50fbb04b7289 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:15.172410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea4e259e-1f47-4671-ae8a-50fbb04b7289 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:15.174519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea4e259e-1f47-4671-ae8a-50fbb04b7289 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:15.176319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ea4e259e-1f47-4671-ae8a-50fbb04b7289 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1721 microversion: 2.20 time: 0.275595 Apr 19 03:42:15.177108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 328/613] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:14 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:15.588848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1ce8e037-8f93-4507-ac76-a734777db47c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:15.589440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1ce8e037-8f93-4507-ac76-a734777db47c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:15.598164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ce8e037-8f93-4507-ac76-a734777db47c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:15.598672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ce8e037-8f93-4507-ac76-a734777db47c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:15.599558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ce8e037-8f93-4507-ac76-a734777db47c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:15.600056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ce8e037-8f93-4507-ac76-a734777db47c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:15.640641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6a2dc21e-e5c7-43ee-87b0-0d02af359a6f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:15.641310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6a2dc21e-e5c7-43ee-87b0-0d02af359a6f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:15.649202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a2dc21e-e5c7-43ee-87b0-0d02af359a6f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:15.649706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a2dc21e-e5c7-43ee-87b0-0d02af359a6f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:15.650539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a2dc21e-e5c7-43ee-87b0-0d02af359a6f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:15.651032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a2dc21e-e5c7-43ee-87b0-0d02af359a6f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:15.782994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6a2dc21e-e5c7-43ee-87b0-0d02af359a6f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:15.792335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6a2dc21e-e5c7-43ee-87b0-0d02af359a6f tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1143 microversion: 2.1 time: 0.155719 Apr 19 03:42:15.792960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 329/614] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:15 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1143 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:15.814178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1ce8e037-8f93-4507-ac76-a734777db47c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:15.823325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1ce8e037-8f93-4507-ac76-a734777db47c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1666 microversion: 2.1 time: 0.238794 Apr 19 03:42:15.823946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 286/615] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:15 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1666 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:16.197624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a63ce969-b82b-4905-a959-ae4048fe0bc5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:16.198346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a63ce969-b82b-4905-a959-ae4048fe0bc5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:16.206703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a63ce969-b82b-4905-a959-ae4048fe0bc5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:16.207764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a63ce969-b82b-4905-a959-ae4048fe0bc5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:16.209057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a63ce969-b82b-4905-a959-ae4048fe0bc5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:16.210650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a63ce969-b82b-4905-a959-ae4048fe0bc5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:16.340130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1186091870", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-289167008", "security_groups": [{"name": "tempest-secgroup-smoke-241105613"}], "networks": [{"uuid": "bc40c6dd-681c-4758-8425-824537fa20a5"}], "block_device_mapping_v2": [{"uuid": "22a11c52-fc24-4b14-b8f3-543bb2f1e89e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:16.479995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a63ce969-b82b-4905-a959-ae4048fe0bc5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:16.490887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a63ce969-b82b-4905-a959-ae4048fe0bc5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:16.492630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a63ce969-b82b-4905-a959-ae4048fe0bc5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:16.493930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a63ce969-b82b-4905-a959-ae4048fe0bc5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1721 microversion: 2.20 time: 0.300618 Apr 19 03:42:16.494553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 330/616] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:16 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:16.660597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] validate_networks() for [('bc40c6dd-681c-4758-8425-824537fa20a5', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:42:16.815834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-76a4297f-f6c0-4025-a7f8-a7b7e53fed78 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:16.816490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-76a4297f-f6c0-4025-a7f8-a7b7e53fed78 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:16.835357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76a4297f-f6c0-4025-a7f8-a7b7e53fed78 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:16.835979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76a4297f-f6c0-4025-a7f8-a7b7e53fed78 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:16.836687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76a4297f-f6c0-4025-a7f8-a7b7e53fed78 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:16.837176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76a4297f-f6c0-4025-a7f8-a7b7e53fed78 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:16.979526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-76a4297f-f6c0-4025-a7f8-a7b7e53fed78 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:16.991960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-76a4297f-f6c0-4025-a7f8-a7b7e53fed78 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1191 microversion: 2.1 time: 0.185274 Apr 19 03:42:16.992601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 331/617] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:16 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1191 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:17.458337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:42:17.458813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:42:17.459405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:42:17.459861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:42:17.460320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:42:17.469214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:17.469835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:17.470705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:17.471220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:17.491709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Getting quotas for project 9685547739384db983b365ae780e9d90. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:42:17.496208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Getting quotas for user 7857d2962cae4aed923735a1ebe781f0 and project 9685547739384db983b365ae780e9d90. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:42:17.514161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-89a58309-f82f-41c8-9eac-11cee3261500 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:17.515521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-89a58309-f82f-41c8-9eac-11cee3261500 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:17.525492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89a58309-f82f-41c8-9eac-11cee3261500 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:17.526003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89a58309-f82f-41c8-9eac-11cee3261500 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:17.527025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89a58309-f82f-41c8-9eac-11cee3261500 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:17.531348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89a58309-f82f-41c8-9eac-11cee3261500 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:17.610315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:42:17.613048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22a11c52-fc24-4b14-b8f3-543bb2f1e89e',volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:42:17.759730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-89a58309-f82f-41c8-9eac-11cee3261500 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:17.769303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-89a58309-f82f-41c8-9eac-11cee3261500 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:17.771038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-89a58309-f82f-41c8-9eac-11cee3261500 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:17.772798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-89a58309-f82f-41c8-9eac-11cee3261500 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1724 microversion: 2.20 time: 0.262778 Apr 19 03:42:17.773418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 332/618] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:17 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:42:17.792478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c5b230d0-604d-4f4a-86d4-5194812d31ba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dc14a02-a0a2-4aac-a115-4bc72bc806f6"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:17.794001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c5b230d0-604d-4f4a-86d4-5194812d31ba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:17.801960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5b230d0-604d-4f4a-86d4-5194812d31ba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:17.802518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5b230d0-604d-4f4a-86d4-5194812d31ba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:17.803392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5b230d0-604d-4f4a-86d4-5194812d31ba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:17.803921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5b230d0-604d-4f4a-86d4-5194812d31ba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:17.924993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [f9003367-21c3-406b-8888-381d8c7d8b81] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 19 03:42:18.829852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c5b230d0-604d-4f4a-86d4-5194812d31ba tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.042116 Apr 19 03:42:18.830471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 333/619] 10.222.0.25 () {62 vars in 1354 bytes} [Mon Apr 19 03:42:17 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/os-volume_attachments => generated 188 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 19 03:42:18.835570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-707a9344-0028-4077-9ca6-a76996fe3b21 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:18.841482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-707a9344-0028-4077-9ca6-a76996fe3b21 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:18.844840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-707a9344-0028-4077-9ca6-a76996fe3b21 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:18.845403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-707a9344-0028-4077-9ca6-a76996fe3b21 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:18.846191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-707a9344-0028-4077-9ca6-a76996fe3b21 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:18.846691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-707a9344-0028-4077-9ca6-a76996fe3b21 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:18.944132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [f9003367-21c3-406b-8888-381d8c7d8b81] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 35642. Apr 19 03:42:18.948146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c0292a2a-7d73-4907-a8f6-61a399d3e04f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.613397 Apr 19 03:42:18.948847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 287/620] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:42:16 2021] POST /compute/v2.1/servers => generated 405 bytes in 2615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:42:18.954488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-98c70716-e07c-4d3a-867f-e4dbb4007ee3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:18.955586 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-98c70716-e07c-4d3a-867f-e4dbb4007ee3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:18.965797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98c70716-e07c-4d3a-867f-e4dbb4007ee3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:18.966299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98c70716-e07c-4d3a-867f-e4dbb4007ee3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:18.967363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98c70716-e07c-4d3a-867f-e4dbb4007ee3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:18.967861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98c70716-e07c-4d3a-867f-e4dbb4007ee3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:18.983486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-707a9344-0028-4077-9ca6-a76996fe3b21 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:18.993252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-707a9344-0028-4077-9ca6-a76996fe3b21 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1209 microversion: 2.1 time: 0.161721 Apr 19 03:42:19.003549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 334/621] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:18 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1209 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:19.003549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3d6a908f-0281-4981-a1c3-672b076a76b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:19.003549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3d6a908f-0281-4981-a1c3-672b076a76b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:19.130872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3d6a908f-0281-4981-a1c3-672b076a76b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:19.139312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3d6a908f-0281-4981-a1c3-672b076a76b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1088 microversion: 2.1 time: 0.144413 Apr 19 03:42:19.140018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 335/622] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:18 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1088 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:19.245594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-98c70716-e07c-4d3a-867f-e4dbb4007ee3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action" status: 202 len: 0 microversion: 2.20 time: 0.295070 Apr 19 03:42:19.249371 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 288/623] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:42:18 2021] POST /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:42:19.254827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a2c1ca0d-a421-49c2-883b-ce53e7b9e58a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:19.255514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a2c1ca0d-a421-49c2-883b-ce53e7b9e58a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:19.265991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2c1ca0d-a421-49c2-883b-ce53e7b9e58a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:19.266495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2c1ca0d-a421-49c2-883b-ce53e7b9e58a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:19.267412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2c1ca0d-a421-49c2-883b-ce53e7b9e58a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:19.268078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2c1ca0d-a421-49c2-883b-ce53e7b9e58a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:19.514282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a2c1ca0d-a421-49c2-883b-ce53e7b9e58a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:19.525372 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a2c1ca0d-a421-49c2-883b-ce53e7b9e58a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:19.527053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a2c1ca0d-a421-49c2-883b-ce53e7b9e58a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:19.528384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a2c1ca0d-a421-49c2-883b-ce53e7b9e58a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1810 microversion: 2.20 time: 0.277655 Apr 19 03:42:19.528997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 336/624] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:19 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1810 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:20.012516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8826900e-4722-45ae-aa07-409c766756cc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:20.013208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8826900e-4722-45ae-aa07-409c766756cc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:20.021383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8826900e-4722-45ae-aa07-409c766756cc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:20.021982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8826900e-4722-45ae-aa07-409c766756cc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:20.022935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8826900e-4722-45ae-aa07-409c766756cc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:20.024060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8826900e-4722-45ae-aa07-409c766756cc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:20.149965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8826900e-4722-45ae-aa07-409c766756cc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:20.158317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8d1795c4-f754-430d-8a3c-226cd24ea8ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:20.158976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8d1795c4-f754-430d-8a3c-226cd24ea8ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:20.159645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8826900e-4722-45ae-aa07-409c766756cc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1209 microversion: 2.1 time: 0.151420 Apr 19 03:42:20.160483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 289/625] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:20 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1209 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:42:20.170643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d1795c4-f754-430d-8a3c-226cd24ea8ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:20.170643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d1795c4-f754-430d-8a3c-226cd24ea8ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:20.172268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d1795c4-f754-430d-8a3c-226cd24ea8ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:20.172738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d1795c4-f754-430d-8a3c-226cd24ea8ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:20.302162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8d1795c4-f754-430d-8a3c-226cd24ea8ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:20.313483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8d1795c4-f754-430d-8a3c-226cd24ea8ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1138 microversion: 2.1 time: 0.159302 Apr 19 03:42:20.314159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 337/626] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:20 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1138 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:20.526271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-275d46a9-c031-494e-9318-324155a3abc5 req-2104d5a2-209f-4e5a-91cc-54556f5c03c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29b14f0-f43c-434b-b583-cdf6b0e4b784", "name": "network-vif-unplugged", "status": "completed", "tag": "8b1a69d0-ba1e-4994-b669-cc0e63d13b8b"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:20.526271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:42:20.526271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:42:20.534346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-275d46a9-c031-494e-9318-324155a3abc5 req-2104d5a2-209f-4e5a-91cc-54556f5c03c4 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:20.535063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-275d46a9-c031-494e-9318-324155a3abc5 req-2104d5a2-209f-4e5a-91cc-54556f5c03c4 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:20.549054 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8675c1bc-0f4d-4664-901a-e28e8f989be3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:20.549998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8675c1bc-0f4d-4664-901a-e28e8f989be3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:20.578178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8675c1bc-0f4d-4664-901a-e28e8f989be3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:20.578921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8675c1bc-0f4d-4664-901a-e28e8f989be3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:20.588318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8675c1bc-0f4d-4664-901a-e28e8f989be3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:20.589092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8675c1bc-0f4d-4664-901a-e28e8f989be3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:20.597637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-275d46a9-c031-494e-9318-324155a3abc5 req-2104d5a2-209f-4e5a-91cc-54556f5c03c4 service nova] Creating event network-vif-unplugged:8b1a69d0-ba1e-4994-b669-cc0e63d13b8b for instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 on hv-cinder-78605 Apr 19 03:42:20.610747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-275d46a9-c031-494e-9318-324155a3abc5 req-2104d5a2-209f-4e5a-91cc-54556f5c03c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091262 Apr 19 03:42:20.612428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 290/627] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:42:20 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:42:20.893497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8675c1bc-0f4d-4664-901a-e28e8f989be3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:20.904457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8675c1bc-0f4d-4664-901a-e28e8f989be3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:20.906127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8675c1bc-0f4d-4664-901a-e28e8f989be3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:20.907482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8675c1bc-0f4d-4664-901a-e28e8f989be3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1810 microversion: 2.20 time: 0.362830 Apr 19 03:42:20.908046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 338/628] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:20 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1810 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:21.178673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4d4dbb3b-3671-40a4-ad3f-8f8e4af25f3e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:21.180232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4d4dbb3b-3671-40a4-ad3f-8f8e4af25f3e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:21.192232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d4dbb3b-3671-40a4-ad3f-8f8e4af25f3e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:21.193425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d4dbb3b-3671-40a4-ad3f-8f8e4af25f3e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:21.194957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d4dbb3b-3671-40a4-ad3f-8f8e4af25f3e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:21.195683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d4dbb3b-3671-40a4-ad3f-8f8e4af25f3e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:21.332797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2a6006f7-f9d7-4965-a192-c471b4da9ccd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:21.334654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2a6006f7-f9d7-4965-a192-c471b4da9ccd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:21.343658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a6006f7-f9d7-4965-a192-c471b4da9ccd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:21.349262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a6006f7-f9d7-4965-a192-c471b4da9ccd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:21.350549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a6006f7-f9d7-4965-a192-c471b4da9ccd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:21.351298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a6006f7-f9d7-4965-a192-c471b4da9ccd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:21.419022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4d4dbb3b-3671-40a4-ad3f-8f8e4af25f3e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:21.429390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4d4dbb3b-3671-40a4-ad3f-8f8e4af25f3e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1209 microversion: 2.1 time: 0.255092 Apr 19 03:42:21.439463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 291/629] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:21 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1209 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:21.542516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2a6006f7-f9d7-4965-a192-c471b4da9ccd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:21.569940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2a6006f7-f9d7-4965-a192-c471b4da9ccd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1194 microversion: 2.1 time: 0.240876 Apr 19 03:42:21.575996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 339/630] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:21 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:21.928673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f4e2d8a0-bc5c-48ac-8caf-66071737c36f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:21.929602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f4e2d8a0-bc5c-48ac-8caf-66071737c36f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:21.937784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f4e2d8a0-bc5c-48ac-8caf-66071737c36f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:21.938530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f4e2d8a0-bc5c-48ac-8caf-66071737c36f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:21.939626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f4e2d8a0-bc5c-48ac-8caf-66071737c36f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:21.940312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f4e2d8a0-bc5c-48ac-8caf-66071737c36f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:22.447787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-59f9422c-b2b2-415f-80f1-ce928f62a324 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:22.448418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-59f9422c-b2b2-415f-80f1-ce928f62a324 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:22.466416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-59f9422c-b2b2-415f-80f1-ce928f62a324 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:22.466922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-59f9422c-b2b2-415f-80f1-ce928f62a324 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:22.467971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-59f9422c-b2b2-415f-80f1-ce928f62a324 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:22.468463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-59f9422c-b2b2-415f-80f1-ce928f62a324 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:22.855843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f4e2d8a0-bc5c-48ac-8caf-66071737c36f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:22.867883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f4e2d8a0-bc5c-48ac-8caf-66071737c36f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:22.882440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f4e2d8a0-bc5c-48ac-8caf-66071737c36f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:22.884478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f4e2d8a0-bc5c-48ac-8caf-66071737c36f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1752 microversion: 2.20 time: 0.960420 Apr 19 03:42:22.886936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 292/631] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:21 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1752 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:22.900167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d4569a31-7277-4af4-b744-b601778d8596 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:22.903352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d4569a31-7277-4af4-b744-b601778d8596 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:22.914687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d4569a31-7277-4af4-b744-b601778d8596 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:22.915523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d4569a31-7277-4af4-b744-b601778d8596 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:22.917006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d4569a31-7277-4af4-b744-b601778d8596 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:22.918126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d4569a31-7277-4af4-b744-b601778d8596 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:23.295215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-59f9422c-b2b2-415f-80f1-ce928f62a324 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:23.307981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-59f9422c-b2b2-415f-80f1-ce928f62a324 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.864557 Apr 19 03:42:23.323680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 340/632] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:22 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:23.390192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d4569a31-7277-4af4-b744-b601778d8596 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:23.415782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d4569a31-7277-4af4-b744-b601778d8596 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1271 microversion: 2.1 time: 0.526527 Apr 19 03:42:23.416504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 293/633] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:22 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1271 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:23.913341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-be90b689-dc6c-4c5a-9d4c-036e2467fdda tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:23.914016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-be90b689-dc6c-4c5a-9d4c-036e2467fdda tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:23.922571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be90b689-dc6c-4c5a-9d4c-036e2467fdda tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:23.923353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be90b689-dc6c-4c5a-9d4c-036e2467fdda tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:23.924381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be90b689-dc6c-4c5a-9d4c-036e2467fdda tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:23.925025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be90b689-dc6c-4c5a-9d4c-036e2467fdda tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:24.316171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-c97e0eef-66c2-486b-b096-7764952f7d33 req-54a6a290-9f9d-4cfa-8496-7b2cd3254392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e2695b-dd12-444c-8d09-a65518f70b76", "tag": "cdee7d9f-4c20-4572-8d6d-32ffe46d4cfe"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:24.318143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:42:24.318143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:42:24.334935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-c97e0eef-66c2-486b-b096-7764952f7d33 req-54a6a290-9f9d-4cfa-8496-7b2cd3254392 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:24.335469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-c97e0eef-66c2-486b-b096-7764952f7d33 req-54a6a290-9f9d-4cfa-8496-7b2cd3254392 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:24.365802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-c97e0eef-66c2-486b-b096-7764952f7d33 req-54a6a290-9f9d-4cfa-8496-7b2cd3254392 service nova] Creating event network-changed:cdee7d9f-4c20-4572-8d6d-32ffe46d4cfe for instance b1e2695b-dd12-444c-8d09-a65518f70b76 on hv-cinder-78605 Apr 19 03:42:24.374163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-c97e0eef-66c2-486b-b096-7764952f7d33 req-54a6a290-9f9d-4cfa-8496-7b2cd3254392 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061811 Apr 19 03:42:24.374948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 294/634] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:42:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:42:24.384290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3c101be0-76f0-4506-8228-d83fe04ecaac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:24.385078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3c101be0-76f0-4506-8228-d83fe04ecaac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:24.394215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-be90b689-dc6c-4c5a-9d4c-036e2467fdda tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:24.394444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c101be0-76f0-4506-8228-d83fe04ecaac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:24.395021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c101be0-76f0-4506-8228-d83fe04ecaac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:24.395642 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c101be0-76f0-4506-8228-d83fe04ecaac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:24.396316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c101be0-76f0-4506-8228-d83fe04ecaac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:24.411637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-be90b689-dc6c-4c5a-9d4c-036e2467fdda tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:24.413898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-be90b689-dc6c-4c5a-9d4c-036e2467fdda tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:24.415132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-be90b689-dc6c-4c5a-9d4c-036e2467fdda tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1752 microversion: 2.20 time: 0.506587 Apr 19 03:42:24.419908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 341/635] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:23 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1752 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:42:24.434112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2db374e6-64cd-426d-a653-69cdf0d9408a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:24.434792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2db374e6-64cd-426d-a653-69cdf0d9408a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:24.446567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2db374e6-64cd-426d-a653-69cdf0d9408a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:24.447085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2db374e6-64cd-426d-a653-69cdf0d9408a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:24.448015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2db374e6-64cd-426d-a653-69cdf0d9408a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:24.448523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2db374e6-64cd-426d-a653-69cdf0d9408a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:24.719764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3c101be0-76f0-4506-8228-d83fe04ecaac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:24.728939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3c101be0-76f0-4506-8228-d83fe04ecaac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.350339 Apr 19 03:42:24.729595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 295/636] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:24 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:24.940725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-98b8cb60-de1f-4941-bf77-e82ad746a380 req-d4e715dc-9bad-46b3-b6a4-6708323e7c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc5cf11-07e5-4749-b662-5d41fef38609", "tag": "fbdc9349-8214-499d-88ec-f32902245c65"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:24.942943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:42:24.942943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:42:24.953471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-98b8cb60-de1f-4941-bf77-e82ad746a380 req-d4e715dc-9bad-46b3-b6a4-6708323e7c51 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:24.954056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-98b8cb60-de1f-4941-bf77-e82ad746a380 req-d4e715dc-9bad-46b3-b6a4-6708323e7c51 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:24.970575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2db374e6-64cd-426d-a653-69cdf0d9408a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:24.973462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-98b8cb60-de1f-4941-bf77-e82ad746a380 req-d4e715dc-9bad-46b3-b6a4-6708323e7c51 service nova] Creating event network-changed:fbdc9349-8214-499d-88ec-f32902245c65 for instance 3cc5cf11-07e5-4749-b662-5d41fef38609 on hv-cinder-78605 Apr 19 03:42:24.979007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-98b8cb60-de1f-4941-bf77-e82ad746a380 req-d4e715dc-9bad-46b3-b6a4-6708323e7c51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042028 Apr 19 03:42:24.979703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 296/637] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:42:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:42:24.980639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2db374e6-64cd-426d-a653-69cdf0d9408a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.550472 Apr 19 03:42:24.981348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 342/638] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:24 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:25.438866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6915bc10-418f-44df-bd09-5ca842e0f7ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:25.439660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6915bc10-418f-44df-bd09-5ca842e0f7ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:25.447781 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6915bc10-418f-44df-bd09-5ca842e0f7ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:25.448283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6915bc10-418f-44df-bd09-5ca842e0f7ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:25.449108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6915bc10-418f-44df-bd09-5ca842e0f7ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:25.449596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6915bc10-418f-44df-bd09-5ca842e0f7ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:25.662892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6915bc10-418f-44df-bd09-5ca842e0f7ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:25.673047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6915bc10-418f-44df-bd09-5ca842e0f7ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:25.674711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6915bc10-418f-44df-bd09-5ca842e0f7ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:25.675954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6915bc10-418f-44df-bd09-5ca842e0f7ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1752 microversion: 2.20 time: 0.241807 Apr 19 03:42:25.676559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 297/639] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:25 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1752 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:25.747229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d7aa5526-5cc0-4a25-a1f2-f1a74bc3ba07 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:25.747907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d7aa5526-5cc0-4a25-a1f2-f1a74bc3ba07 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:25.755664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7aa5526-5cc0-4a25-a1f2-f1a74bc3ba07 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:25.756219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7aa5526-5cc0-4a25-a1f2-f1a74bc3ba07 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:25.757050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7aa5526-5cc0-4a25-a1f2-f1a74bc3ba07 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:25.757543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7aa5526-5cc0-4a25-a1f2-f1a74bc3ba07 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:25.965456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d7aa5526-5cc0-4a25-a1f2-f1a74bc3ba07 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:25.974381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d7aa5526-5cc0-4a25-a1f2-f1a74bc3ba07 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.231230 Apr 19 03:42:25.975625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 343/640] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:25 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:25.997995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6ec31985-d558-41c1-9b0c-562f88fa4246 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:25.998665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6ec31985-d558-41c1-9b0c-562f88fa4246 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:26.006461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ec31985-d558-41c1-9b0c-562f88fa4246 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:26.006967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ec31985-d558-41c1-9b0c-562f88fa4246 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:26.007828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ec31985-d558-41c1-9b0c-562f88fa4246 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:26.008323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ec31985-d558-41c1-9b0c-562f88fa4246 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:26.218907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6ec31985-d558-41c1-9b0c-562f88fa4246 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:26.228042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6ec31985-d558-41c1-9b0c-562f88fa4246 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.234074 Apr 19 03:42:26.228658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 298/641] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:25 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:26.697016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-23420c05-fbef-4ac6-9652-624f28037358 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:26.697685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-23420c05-fbef-4ac6-9652-624f28037358 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:26.705614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-23420c05-fbef-4ac6-9652-624f28037358 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:26.706127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-23420c05-fbef-4ac6-9652-624f28037358 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:26.706964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-23420c05-fbef-4ac6-9652-624f28037358 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:26.707491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-23420c05-fbef-4ac6-9652-624f28037358 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:26.918787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-23420c05-fbef-4ac6-9652-624f28037358 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:26.929417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-23420c05-fbef-4ac6-9652-624f28037358 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:26.931098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-23420c05-fbef-4ac6-9652-624f28037358 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:26.932374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-23420c05-fbef-4ac6-9652-624f28037358 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1752 microversion: 2.20 time: 0.240260 Apr 19 03:42:26.932984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 344/642] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:26 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1752 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:26.993724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-97c21ac7-fcc7-4821-a9ee-ffc8829dcc16 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:26.994383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-97c21ac7-fcc7-4821-a9ee-ffc8829dcc16 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:27.002126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-97c21ac7-fcc7-4821-a9ee-ffc8829dcc16 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:27.002624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-97c21ac7-fcc7-4821-a9ee-ffc8829dcc16 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:27.003492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-97c21ac7-fcc7-4821-a9ee-ffc8829dcc16 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:27.003977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-97c21ac7-fcc7-4821-a9ee-ffc8829dcc16 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:27.213469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-97c21ac7-fcc7-4821-a9ee-ffc8829dcc16 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:27.222381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-97c21ac7-fcc7-4821-a9ee-ffc8829dcc16 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.233366 Apr 19 03:42:27.223013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 299/643] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:26 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:27.246667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-46e23a92-56da-45e9-ab9d-540cfc818de7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:27.247476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-46e23a92-56da-45e9-ab9d-540cfc818de7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:27.255421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-46e23a92-56da-45e9-ab9d-540cfc818de7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:27.255959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-46e23a92-56da-45e9-ab9d-540cfc818de7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:27.256792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-46e23a92-56da-45e9-ab9d-540cfc818de7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:27.257285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-46e23a92-56da-45e9-ab9d-540cfc818de7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:27.701863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-46e23a92-56da-45e9-ab9d-540cfc818de7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:27.712557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-46e23a92-56da-45e9-ab9d-540cfc818de7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.469962 Apr 19 03:42:27.713964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 345/644] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:27 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:27.952146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-eec3e257-3a2c-4c06-88fb-2f1c33f8690a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:27.952873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-eec3e257-3a2c-4c06-88fb-2f1c33f8690a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:27.961559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eec3e257-3a2c-4c06-88fb-2f1c33f8690a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:27.962109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eec3e257-3a2c-4c06-88fb-2f1c33f8690a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:27.963834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eec3e257-3a2c-4c06-88fb-2f1c33f8690a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:27.964334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eec3e257-3a2c-4c06-88fb-2f1c33f8690a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:28.241653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bf58bbec-9729-4bf3-8772-bc5e284da382 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:28.242925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bf58bbec-9729-4bf3-8772-bc5e284da382 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:28.251351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf58bbec-9729-4bf3-8772-bc5e284da382 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:28.251864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf58bbec-9729-4bf3-8772-bc5e284da382 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:28.252703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf58bbec-9729-4bf3-8772-bc5e284da382 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:28.253199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf58bbec-9729-4bf3-8772-bc5e284da382 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:28.330649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-eec3e257-3a2c-4c06-88fb-2f1c33f8690a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:28.342737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-eec3e257-3a2c-4c06-88fb-2f1c33f8690a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:28.344604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-eec3e257-3a2c-4c06-88fb-2f1c33f8690a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:28.345842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-eec3e257-3a2c-4c06-88fb-2f1c33f8690a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1752 microversion: 2.20 time: 0.398090 Apr 19 03:42:28.347011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 300/645] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:27 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1752 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:28.613200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bf58bbec-9729-4bf3-8772-bc5e284da382 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:28.622623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bf58bbec-9729-4bf3-8772-bc5e284da382 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.385936 Apr 19 03:42:28.623262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 346/646] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:28 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:28.730951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f86564e0-8ed1-4684-95aa-4f2aa9c5ac0a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:28.731821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f86564e0-8ed1-4684-95aa-4f2aa9c5ac0a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:28.740051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f86564e0-8ed1-4684-95aa-4f2aa9c5ac0a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:28.741190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f86564e0-8ed1-4684-95aa-4f2aa9c5ac0a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:28.742228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f86564e0-8ed1-4684-95aa-4f2aa9c5ac0a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:28.742836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f86564e0-8ed1-4684-95aa-4f2aa9c5ac0a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:29.039394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f86564e0-8ed1-4684-95aa-4f2aa9c5ac0a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:29.045560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f86564e0-8ed1-4684-95aa-4f2aa9c5ac0a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.318781 Apr 19 03:42:29.055121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 301/647] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:28 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:29.366871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ea90235b-57c0-4850-b269-c821e2f2d6dd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:29.369563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ea90235b-57c0-4850-b269-c821e2f2d6dd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:29.375401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea90235b-57c0-4850-b269-c821e2f2d6dd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:29.375912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea90235b-57c0-4850-b269-c821e2f2d6dd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:29.376783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea90235b-57c0-4850-b269-c821e2f2d6dd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:29.377274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea90235b-57c0-4850-b269-c821e2f2d6dd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:29.624697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea90235b-57c0-4850-b269-c821e2f2d6dd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:29.637368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea90235b-57c0-4850-b269-c821e2f2d6dd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:29.637368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea90235b-57c0-4850-b269-c821e2f2d6dd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:29.638649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ea90235b-57c0-4850-b269-c821e2f2d6dd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.276277 Apr 19 03:42:29.639748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 347/648] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:29 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:29.643106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2ebd3c9f-2689-45e5-b66a-aa11cf30173d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:29.643788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2ebd3c9f-2689-45e5-b66a-aa11cf30173d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:29.652566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ebd3c9f-2689-45e5-b66a-aa11cf30173d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:29.653065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ebd3c9f-2689-45e5-b66a-aa11cf30173d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:29.654014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ebd3c9f-2689-45e5-b66a-aa11cf30173d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:29.654509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ebd3c9f-2689-45e5-b66a-aa11cf30173d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:29.908239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2ebd3c9f-2689-45e5-b66a-aa11cf30173d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:29.919374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2ebd3c9f-2689-45e5-b66a-aa11cf30173d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.280288 Apr 19 03:42:29.930236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 302/649] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:29 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:42:30.064118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3dcefdf3-874a-4398-a3c5-3a92fb40faa7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:30.065537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3dcefdf3-874a-4398-a3c5-3a92fb40faa7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:30.074871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3dcefdf3-874a-4398-a3c5-3a92fb40faa7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:30.075663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3dcefdf3-874a-4398-a3c5-3a92fb40faa7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:30.076812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3dcefdf3-874a-4398-a3c5-3a92fb40faa7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:30.077386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3dcefdf3-874a-4398-a3c5-3a92fb40faa7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:30.305342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3dcefdf3-874a-4398-a3c5-3a92fb40faa7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:30.314544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3dcefdf3-874a-4398-a3c5-3a92fb40faa7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.254630 Apr 19 03:42:30.315202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 348/650] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:30 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:30.659408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7ab6fae6-d3b4-4818-8f1f-2a0a2525986b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:30.660072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7ab6fae6-d3b4-4818-8f1f-2a0a2525986b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:30.668573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ab6fae6-d3b4-4818-8f1f-2a0a2525986b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:30.669074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ab6fae6-d3b4-4818-8f1f-2a0a2525986b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:30.669893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ab6fae6-d3b4-4818-8f1f-2a0a2525986b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:30.670381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ab6fae6-d3b4-4818-8f1f-2a0a2525986b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:30.882079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7ab6fae6-d3b4-4818-8f1f-2a0a2525986b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:30.891964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7ab6fae6-d3b4-4818-8f1f-2a0a2525986b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:30.893657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7ab6fae6-d3b4-4818-8f1f-2a0a2525986b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:30.894888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7ab6fae6-d3b4-4818-8f1f-2a0a2525986b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.239790 Apr 19 03:42:30.895568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 303/651] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:30 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:30.937675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8edbe949-3e17-4a1b-a410-d91be2b22922 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:30.938613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8edbe949-3e17-4a1b-a410-d91be2b22922 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:30.947278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8edbe949-3e17-4a1b-a410-d91be2b22922 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:30.948052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8edbe949-3e17-4a1b-a410-d91be2b22922 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:30.949118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8edbe949-3e17-4a1b-a410-d91be2b22922 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:30.949816 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8edbe949-3e17-4a1b-a410-d91be2b22922 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:31.170185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8edbe949-3e17-4a1b-a410-d91be2b22922 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:31.179364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8edbe949-3e17-4a1b-a410-d91be2b22922 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.245897 Apr 19 03:42:31.180201 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 349/652] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:30 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:31.334706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-743c2a60-2d3d-4be8-9121-282ede6d4cc9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:31.335431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-743c2a60-2d3d-4be8-9121-282ede6d4cc9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:31.343427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-743c2a60-2d3d-4be8-9121-282ede6d4cc9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:31.343942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-743c2a60-2d3d-4be8-9121-282ede6d4cc9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:31.344798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-743c2a60-2d3d-4be8-9121-282ede6d4cc9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:31.345293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-743c2a60-2d3d-4be8-9121-282ede6d4cc9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:31.712331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-743c2a60-2d3d-4be8-9121-282ede6d4cc9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:31.721465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-743c2a60-2d3d-4be8-9121-282ede6d4cc9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.391940 Apr 19 03:42:31.722314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 304/653] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:31 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:31.914376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ea84f41a-e9c5-4aaa-bb30-cd86de3311dc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:31.915343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ea84f41a-e9c5-4aaa-bb30-cd86de3311dc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:31.923212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea84f41a-e9c5-4aaa-bb30-cd86de3311dc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:31.923743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea84f41a-e9c5-4aaa-bb30-cd86de3311dc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:31.924562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea84f41a-e9c5-4aaa-bb30-cd86de3311dc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:31.925049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea84f41a-e9c5-4aaa-bb30-cd86de3311dc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:32.154775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea84f41a-e9c5-4aaa-bb30-cd86de3311dc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:32.165773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea84f41a-e9c5-4aaa-bb30-cd86de3311dc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:32.167087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea84f41a-e9c5-4aaa-bb30-cd86de3311dc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:32.168321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ea84f41a-e9c5-4aaa-bb30-cd86de3311dc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.258169 Apr 19 03:42:32.168932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 350/654] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:31 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:32.197016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-37482e7c-6e83-4d6d-9035-b591987b7a6d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:32.197743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-37482e7c-6e83-4d6d-9035-b591987b7a6d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:32.205579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37482e7c-6e83-4d6d-9035-b591987b7a6d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:32.206080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37482e7c-6e83-4d6d-9035-b591987b7a6d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:32.206948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37482e7c-6e83-4d6d-9035-b591987b7a6d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:32.207570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37482e7c-6e83-4d6d-9035-b591987b7a6d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:32.434864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-37482e7c-6e83-4d6d-9035-b591987b7a6d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:32.444200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-37482e7c-6e83-4d6d-9035-b591987b7a6d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.251297 Apr 19 03:42:32.444832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 305/655] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:32 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:32.740859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-946c9aef-7b96-453e-85bf-56f10ea4ccc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:32.741563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-946c9aef-7b96-453e-85bf-56f10ea4ccc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:32.750238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-946c9aef-7b96-453e-85bf-56f10ea4ccc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:32.750738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-946c9aef-7b96-453e-85bf-56f10ea4ccc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:32.751617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-946c9aef-7b96-453e-85bf-56f10ea4ccc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:32.752101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-946c9aef-7b96-453e-85bf-56f10ea4ccc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:32.976305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-946c9aef-7b96-453e-85bf-56f10ea4ccc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:32.985127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-946c9aef-7b96-453e-85bf-56f10ea4ccc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.248854 Apr 19 03:42:32.985745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 351/656] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:32 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:33.188616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-11eaa8b9-c132-43b9-9a53-05ed8b8d6cdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:33.189456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-11eaa8b9-c132-43b9-9a53-05ed8b8d6cdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:33.197188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-11eaa8b9-c132-43b9-9a53-05ed8b8d6cdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:33.197689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-11eaa8b9-c132-43b9-9a53-05ed8b8d6cdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:33.198516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-11eaa8b9-c132-43b9-9a53-05ed8b8d6cdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:33.199003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-11eaa8b9-c132-43b9-9a53-05ed8b8d6cdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:33.413723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-11eaa8b9-c132-43b9-9a53-05ed8b8d6cdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:33.423553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-11eaa8b9-c132-43b9-9a53-05ed8b8d6cdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:33.425205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-11eaa8b9-c132-43b9-9a53-05ed8b8d6cdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:33.426415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-11eaa8b9-c132-43b9-9a53-05ed8b8d6cdf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.242058 Apr 19 03:42:33.427015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 306/657] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:33 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:33.462432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-674004e1-943b-4892-80a4-449ef627bc71 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:33.463096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-674004e1-943b-4892-80a4-449ef627bc71 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:33.470862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-674004e1-943b-4892-80a4-449ef627bc71 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:33.471401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-674004e1-943b-4892-80a4-449ef627bc71 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:33.472221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-674004e1-943b-4892-80a4-449ef627bc71 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:33.472706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-674004e1-943b-4892-80a4-449ef627bc71 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:33.687264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-674004e1-943b-4892-80a4-449ef627bc71 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:33.697331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-674004e1-943b-4892-80a4-449ef627bc71 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.238838 Apr 19 03:42:33.697560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 352/658] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:33 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:34.003844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6ff1c73e-156d-4610-a6d3-73f9e131d30f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:34.004534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6ff1c73e-156d-4610-a6d3-73f9e131d30f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:34.013096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ff1c73e-156d-4610-a6d3-73f9e131d30f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:34.013597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ff1c73e-156d-4610-a6d3-73f9e131d30f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:34.014434 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ff1c73e-156d-4610-a6d3-73f9e131d30f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:34.014944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ff1c73e-156d-4610-a6d3-73f9e131d30f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:34.231732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6ff1c73e-156d-4610-a6d3-73f9e131d30f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:34.242477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6ff1c73e-156d-4610-a6d3-73f9e131d30f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.242629 Apr 19 03:42:34.252852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 307/659] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:33 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:34.446147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d171b460-9e83-4e48-b813-2acbbe7c85f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:34.446980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d171b460-9e83-4e48-b813-2acbbe7c85f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:34.462586 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d171b460-9e83-4e48-b813-2acbbe7c85f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:34.468708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d171b460-9e83-4e48-b813-2acbbe7c85f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:34.468708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d171b460-9e83-4e48-b813-2acbbe7c85f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:34.468708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d171b460-9e83-4e48-b813-2acbbe7c85f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:34.701685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d171b460-9e83-4e48-b813-2acbbe7c85f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:34.713288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d171b460-9e83-4e48-b813-2acbbe7c85f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:34.714858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-867b26ea-244b-4ae1-bd82-cecc04366ecc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:34.715706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-867b26ea-244b-4ae1-bd82-cecc04366ecc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:34.715832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d171b460-9e83-4e48-b813-2acbbe7c85f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:34.717474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d171b460-9e83-4e48-b813-2acbbe7c85f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.275406 Apr 19 03:42:34.718466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 353/660] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:34 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:34.725718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-867b26ea-244b-4ae1-bd82-cecc04366ecc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:34.726230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-867b26ea-244b-4ae1-bd82-cecc04366ecc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:34.727128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-867b26ea-244b-4ae1-bd82-cecc04366ecc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:34.727647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-867b26ea-244b-4ae1-bd82-cecc04366ecc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:34.968053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-867b26ea-244b-4ae1-bd82-cecc04366ecc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:34.983877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-867b26ea-244b-4ae1-bd82-cecc04366ecc tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.273211 Apr 19 03:42:34.984565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 308/661] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:34 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:35.261609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-67e441a1-b445-4f55-b6fd-fc7dded37813 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:35.262404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-67e441a1-b445-4f55-b6fd-fc7dded37813 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:35.270523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67e441a1-b445-4f55-b6fd-fc7dded37813 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:35.271022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67e441a1-b445-4f55-b6fd-fc7dded37813 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:35.272452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67e441a1-b445-4f55-b6fd-fc7dded37813 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:35.272938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67e441a1-b445-4f55-b6fd-fc7dded37813 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:35.564296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-67e441a1-b445-4f55-b6fd-fc7dded37813 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:35.595905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-67e441a1-b445-4f55-b6fd-fc7dded37813 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.338674 Apr 19 03:42:35.596628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 354/662] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:35 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:35.738321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bc206a75-935c-4e5f-93be-e0f2efd60445 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:35.740519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bc206a75-935c-4e5f-93be-e0f2efd60445 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:35.749175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc206a75-935c-4e5f-93be-e0f2efd60445 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:35.749929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc206a75-935c-4e5f-93be-e0f2efd60445 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:35.750819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc206a75-935c-4e5f-93be-e0f2efd60445 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:35.751346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc206a75-935c-4e5f-93be-e0f2efd60445 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:35.985943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bc206a75-935c-4e5f-93be-e0f2efd60445 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:35.998222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bc206a75-935c-4e5f-93be-e0f2efd60445 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:35.999980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bc206a75-935c-4e5f-93be-e0f2efd60445 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:36.002602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bc206a75-935c-4e5f-93be-e0f2efd60445 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.267810 Apr 19 03:42:36.004434 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cc8cbf8d-8b25-4d9b-8299-2ad9f7789236 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:36.005100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cc8cbf8d-8b25-4d9b-8299-2ad9f7789236 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:36.013387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 309/663] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:35 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:36.022746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc8cbf8d-8b25-4d9b-8299-2ad9f7789236 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:36.023496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc8cbf8d-8b25-4d9b-8299-2ad9f7789236 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:36.024337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc8cbf8d-8b25-4d9b-8299-2ad9f7789236 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:36.024827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc8cbf8d-8b25-4d9b-8299-2ad9f7789236 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:36.340280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cc8cbf8d-8b25-4d9b-8299-2ad9f7789236 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:36.349822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cc8cbf8d-8b25-4d9b-8299-2ad9f7789236 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.349281 Apr 19 03:42:36.354197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 355/664] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:35 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:36.614291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1f21b891-85a6-41bb-a546-8f5283f47124 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:36.617331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1f21b891-85a6-41bb-a546-8f5283f47124 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:36.623588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f21b891-85a6-41bb-a546-8f5283f47124 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:36.624212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f21b891-85a6-41bb-a546-8f5283f47124 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:36.625150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f21b891-85a6-41bb-a546-8f5283f47124 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:36.625739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f21b891-85a6-41bb-a546-8f5283f47124 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:36.897617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1f21b891-85a6-41bb-a546-8f5283f47124 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:36.907179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1f21b891-85a6-41bb-a546-8f5283f47124 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.297243 Apr 19 03:42:36.907984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 310/665] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:36 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:42:37.022419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8e6f783a-f8cd-48b9-85cc-65f83d61940f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:37.023330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8e6f783a-f8cd-48b9-85cc-65f83d61940f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:37.033204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e6f783a-f8cd-48b9-85cc-65f83d61940f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:37.033719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e6f783a-f8cd-48b9-85cc-65f83d61940f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:37.034712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e6f783a-f8cd-48b9-85cc-65f83d61940f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:37.035262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e6f783a-f8cd-48b9-85cc-65f83d61940f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:37.296946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8e6f783a-f8cd-48b9-85cc-65f83d61940f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:37.313680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8e6f783a-f8cd-48b9-85cc-65f83d61940f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:37.315429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8e6f783a-f8cd-48b9-85cc-65f83d61940f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:37.316701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8e6f783a-f8cd-48b9-85cc-65f83d61940f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.299847 Apr 19 03:42:37.317492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 356/666] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:37 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:37.369158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2392be2e-e8fa-4457-b356-4d93834dacff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:37.369715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2392be2e-e8fa-4457-b356-4d93834dacff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:37.378439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2392be2e-e8fa-4457-b356-4d93834dacff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:37.378949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2392be2e-e8fa-4457-b356-4d93834dacff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:37.380043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2392be2e-e8fa-4457-b356-4d93834dacff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:37.381404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2392be2e-e8fa-4457-b356-4d93834dacff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:37.735669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2392be2e-e8fa-4457-b356-4d93834dacff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:37.747948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2392be2e-e8fa-4457-b356-4d93834dacff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.383545 Apr 19 03:42:37.756356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 311/667] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:37 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:37.925777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0e255613-042c-4f42-b533-cf5eccfae572 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:37.926659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0e255613-042c-4f42-b533-cf5eccfae572 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:37.935455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e255613-042c-4f42-b533-cf5eccfae572 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:37.935970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e255613-042c-4f42-b533-cf5eccfae572 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:37.936960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e255613-042c-4f42-b533-cf5eccfae572 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:37.937461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e255613-042c-4f42-b533-cf5eccfae572 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:38.182011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0e255613-042c-4f42-b533-cf5eccfae572 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:38.191898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0e255613-042c-4f42-b533-cf5eccfae572 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.270200 Apr 19 03:42:38.192828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 357/668] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:37 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:38.336786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6a9935a1-9e60-47cf-888c-dc99ad578e9e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:38.337837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6a9935a1-9e60-47cf-888c-dc99ad578e9e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:38.351566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a9935a1-9e60-47cf-888c-dc99ad578e9e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:38.352230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a9935a1-9e60-47cf-888c-dc99ad578e9e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:38.354770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a9935a1-9e60-47cf-888c-dc99ad578e9e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:38.355327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a9935a1-9e60-47cf-888c-dc99ad578e9e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:38.775177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1c812c52-ebb6-4bb3-b74c-2df379a801e1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:38.775859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1c812c52-ebb6-4bb3-b74c-2df379a801e1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:38.784406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c812c52-ebb6-4bb3-b74c-2df379a801e1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:38.784833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c812c52-ebb6-4bb3-b74c-2df379a801e1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:38.785687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c812c52-ebb6-4bb3-b74c-2df379a801e1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:38.786179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c812c52-ebb6-4bb3-b74c-2df379a801e1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:38.890248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6a9935a1-9e60-47cf-888c-dc99ad578e9e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:38.913468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6a9935a1-9e60-47cf-888c-dc99ad578e9e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:38.916140 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6a9935a1-9e60-47cf-888c-dc99ad578e9e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:38.918087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6a9935a1-9e60-47cf-888c-dc99ad578e9e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.585237 Apr 19 03:42:38.918903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 312/669] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:38 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:39.052490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1c812c52-ebb6-4bb3-b74c-2df379a801e1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:39.061671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1c812c52-ebb6-4bb3-b74c-2df379a801e1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.291529 Apr 19 03:42:39.062324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 358/670] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:38 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:39.218064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ead1b9f8-4141-4f3a-b63d-b5db5d3da6a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:39.218064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ead1b9f8-4141-4f3a-b63d-b5db5d3da6a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:39.232345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ead1b9f8-4141-4f3a-b63d-b5db5d3da6a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:39.232970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ead1b9f8-4141-4f3a-b63d-b5db5d3da6a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:39.233896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ead1b9f8-4141-4f3a-b63d-b5db5d3da6a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:39.234455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ead1b9f8-4141-4f3a-b63d-b5db5d3da6a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:39.466847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ead1b9f8-4141-4f3a-b63d-b5db5d3da6a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:39.476497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ead1b9f8-4141-4f3a-b63d-b5db5d3da6a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.270175 Apr 19 03:42:39.477178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 313/671] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:39 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:39.939031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-311dca4c-e97d-4210-a807-ae30e41656d2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:39.939811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-311dca4c-e97d-4210-a807-ae30e41656d2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:39.951417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-311dca4c-e97d-4210-a807-ae30e41656d2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:39.951417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-311dca4c-e97d-4210-a807-ae30e41656d2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:39.951417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-311dca4c-e97d-4210-a807-ae30e41656d2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:39.951417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-311dca4c-e97d-4210-a807-ae30e41656d2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:40.081130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-24e3a413-19d0-424a-9c0a-28a5e3f86147 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:40.081804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-24e3a413-19d0-424a-9c0a-28a5e3f86147 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:40.091803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24e3a413-19d0-424a-9c0a-28a5e3f86147 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:40.092565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24e3a413-19d0-424a-9c0a-28a5e3f86147 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:40.093608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24e3a413-19d0-424a-9c0a-28a5e3f86147 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:40.094176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24e3a413-19d0-424a-9c0a-28a5e3f86147 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:40.192689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-311dca4c-e97d-4210-a807-ae30e41656d2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:40.205244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-311dca4c-e97d-4210-a807-ae30e41656d2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:40.207697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-311dca4c-e97d-4210-a807-ae30e41656d2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:40.209456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-311dca4c-e97d-4210-a807-ae30e41656d2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.274681 Apr 19 03:42:40.210666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 359/672] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:39 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:40.347717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-24e3a413-19d0-424a-9c0a-28a5e3f86147 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:40.378340 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-24e3a413-19d0-424a-9c0a-28a5e3f86147 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.287147 Apr 19 03:42:40.382636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 314/673] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:40 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:40.497301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-94a98b3f-b44e-4e96-a224-c9f7d9845f82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:40.497908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-94a98b3f-b44e-4e96-a224-c9f7d9845f82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:40.507042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94a98b3f-b44e-4e96-a224-c9f7d9845f82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:40.507581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94a98b3f-b44e-4e96-a224-c9f7d9845f82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:40.508439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94a98b3f-b44e-4e96-a224-c9f7d9845f82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:40.508931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94a98b3f-b44e-4e96-a224-c9f7d9845f82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:40.729946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-94a98b3f-b44e-4e96-a224-c9f7d9845f82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:40.739736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-94a98b3f-b44e-4e96-a224-c9f7d9845f82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.247187 Apr 19 03:42:40.740534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 360/674] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:40 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:41.248763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ab98a98a-d0e3-4b9c-b0a4-a72b129b03a0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:41.249430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ab98a98a-d0e3-4b9c-b0a4-a72b129b03a0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:41.257705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab98a98a-d0e3-4b9c-b0a4-a72b129b03a0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:41.258205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab98a98a-d0e3-4b9c-b0a4-a72b129b03a0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:41.259047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab98a98a-d0e3-4b9c-b0a4-a72b129b03a0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:41.259557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab98a98a-d0e3-4b9c-b0a4-a72b129b03a0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:41.406022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bf1b110f-1367-47ed-b543-955b7dcfdb9b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:41.412010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bf1b110f-1367-47ed-b543-955b7dcfdb9b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:41.430222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf1b110f-1367-47ed-b543-955b7dcfdb9b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:41.431948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf1b110f-1367-47ed-b543-955b7dcfdb9b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:41.433019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf1b110f-1367-47ed-b543-955b7dcfdb9b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:41.433675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf1b110f-1367-47ed-b543-955b7dcfdb9b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:41.582524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ab98a98a-d0e3-4b9c-b0a4-a72b129b03a0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:41.606363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ab98a98a-d0e3-4b9c-b0a4-a72b129b03a0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:41.608649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ab98a98a-d0e3-4b9c-b0a4-a72b129b03a0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:41.610978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ab98a98a-d0e3-4b9c-b0a4-a72b129b03a0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.382931 Apr 19 03:42:41.611936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 315/675] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:41 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:41.676936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bf1b110f-1367-47ed-b543-955b7dcfdb9b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:41.688264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bf1b110f-1367-47ed-b543-955b7dcfdb9b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.294926 Apr 19 03:42:41.689037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 361/676] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:41 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:41.758753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-704914eb-84e0-40ac-b6f7-87b0a9e7d6e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:41.759723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-704914eb-84e0-40ac-b6f7-87b0a9e7d6e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:41.767873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-704914eb-84e0-40ac-b6f7-87b0a9e7d6e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:41.768512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-704914eb-84e0-40ac-b6f7-87b0a9e7d6e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:41.769558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-704914eb-84e0-40ac-b6f7-87b0a9e7d6e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:41.770130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-704914eb-84e0-40ac-b6f7-87b0a9e7d6e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:41.991931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-704914eb-84e0-40ac-b6f7-87b0a9e7d6e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:42.001909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-704914eb-84e0-40ac-b6f7-87b0a9e7d6e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.248019 Apr 19 03:42:42.002743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 316/677] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:41 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:42.631904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c93394eb-7807-4395-9cf4-4e81f7cad217 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:42.632709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c93394eb-7807-4395-9cf4-4e81f7cad217 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:42.640550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c93394eb-7807-4395-9cf4-4e81f7cad217 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:42.641060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c93394eb-7807-4395-9cf4-4e81f7cad217 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:42.641905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c93394eb-7807-4395-9cf4-4e81f7cad217 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:42.642446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c93394eb-7807-4395-9cf4-4e81f7cad217 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:42.707786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8ca962a1-d1a1-45dc-9be5-87f7072864ab tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:42.709355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8ca962a1-d1a1-45dc-9be5-87f7072864ab tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:42.717329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ca962a1-d1a1-45dc-9be5-87f7072864ab tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:42.717916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ca962a1-d1a1-45dc-9be5-87f7072864ab tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:42.718866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ca962a1-d1a1-45dc-9be5-87f7072864ab tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:42.719362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ca962a1-d1a1-45dc-9be5-87f7072864ab tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:42.878595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c93394eb-7807-4395-9cf4-4e81f7cad217 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:42.889396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c93394eb-7807-4395-9cf4-4e81f7cad217 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:42.891201 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c93394eb-7807-4395-9cf4-4e81f7cad217 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:42.892511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c93394eb-7807-4395-9cf4-4e81f7cad217 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.264750 Apr 19 03:42:42.893587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 362/678] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:42 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:42.954216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8ca962a1-d1a1-45dc-9be5-87f7072864ab tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:42.965750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8ca962a1-d1a1-45dc-9be5-87f7072864ab tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.262113 Apr 19 03:42:42.966375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 317/679] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:42 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:43.021732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d40f3b4d-3e6f-4cbb-9010-f677b765b5f6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:43.022417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d40f3b4d-3e6f-4cbb-9010-f677b765b5f6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:43.030238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d40f3b4d-3e6f-4cbb-9010-f677b765b5f6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:43.030745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d40f3b4d-3e6f-4cbb-9010-f677b765b5f6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:43.031610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d40f3b4d-3e6f-4cbb-9010-f677b765b5f6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:43.032103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d40f3b4d-3e6f-4cbb-9010-f677b765b5f6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:43.256157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d40f3b4d-3e6f-4cbb-9010-f677b765b5f6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:43.265294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d40f3b4d-3e6f-4cbb-9010-f677b765b5f6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.248343 Apr 19 03:42:43.265933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 363/680] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:43 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:43.914392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a9a01a13-cac5-400c-931b-623c9c0ce183 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:43.915069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a9a01a13-cac5-400c-931b-623c9c0ce183 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:43.922856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a9a01a13-cac5-400c-931b-623c9c0ce183 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:43.923400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a9a01a13-cac5-400c-931b-623c9c0ce183 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:43.924237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a9a01a13-cac5-400c-931b-623c9c0ce183 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:43.924725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a9a01a13-cac5-400c-931b-623c9c0ce183 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:43.982617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0018c278-2330-45e3-b0f4-c45a5c688f60 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:43.983563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0018c278-2330-45e3-b0f4-c45a5c688f60 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:43.992210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0018c278-2330-45e3-b0f4-c45a5c688f60 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:43.992910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0018c278-2330-45e3-b0f4-c45a5c688f60 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:43.993923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0018c278-2330-45e3-b0f4-c45a5c688f60 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:43.994567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0018c278-2330-45e3-b0f4-c45a5c688f60 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:44.196336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a9a01a13-cac5-400c-931b-623c9c0ce183 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:44.207530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a9a01a13-cac5-400c-931b-623c9c0ce183 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:44.210663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a9a01a13-cac5-400c-931b-623c9c0ce183 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:44.212310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a9a01a13-cac5-400c-931b-623c9c0ce183 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.302640 Apr 19 03:42:44.213330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 318/681] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:43 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:44.284804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-12a6b273-43e4-430a-adf0-88f255d67a2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:44.285707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-12a6b273-43e4-430a-adf0-88f255d67a2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:44.301350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12a6b273-43e4-430a-adf0-88f255d67a2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:44.301350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12a6b273-43e4-430a-adf0-88f255d67a2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:44.301350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12a6b273-43e4-430a-adf0-88f255d67a2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:44.301350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12a6b273-43e4-430a-adf0-88f255d67a2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:44.310090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0018c278-2330-45e3-b0f4-c45a5c688f60 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:44.322665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0018c278-2330-45e3-b0f4-c45a5c688f60 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.343871 Apr 19 03:42:44.332859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 364/682] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:43 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:44.563629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-12a6b273-43e4-430a-adf0-88f255d67a2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:44.581664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-12a6b273-43e4-430a-adf0-88f255d67a2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.302169 Apr 19 03:42:44.582898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 319/683] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:44 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:42:45.233190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c2988a75-6fec-40db-a89b-de48d4a1188c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:45.233959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c2988a75-6fec-40db-a89b-de48d4a1188c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:45.242715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2988a75-6fec-40db-a89b-de48d4a1188c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:45.243250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2988a75-6fec-40db-a89b-de48d4a1188c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:45.244083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2988a75-6fec-40db-a89b-de48d4a1188c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:45.244617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2988a75-6fec-40db-a89b-de48d4a1188c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:45.340504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-beec1a9d-d939-47c7-8f82-edaf1d3cd23d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:45.341461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-beec1a9d-d939-47c7-8f82-edaf1d3cd23d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:45.351238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-beec1a9d-d939-47c7-8f82-edaf1d3cd23d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:45.352275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-beec1a9d-d939-47c7-8f82-edaf1d3cd23d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:45.353559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-beec1a9d-d939-47c7-8f82-edaf1d3cd23d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:45.354639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-beec1a9d-d939-47c7-8f82-edaf1d3cd23d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:45.478983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c2988a75-6fec-40db-a89b-de48d4a1188c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:45.493279 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c2988a75-6fec-40db-a89b-de48d4a1188c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:45.496957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c2988a75-6fec-40db-a89b-de48d4a1188c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:45.498270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c2988a75-6fec-40db-a89b-de48d4a1188c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.269226 Apr 19 03:42:45.498887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 365/684] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:45 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:45.601259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-86bc7fb0-98bd-453b-bc4b-35af3c9ba279 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:45.602332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-86bc7fb0-98bd-453b-bc4b-35af3c9ba279 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:45.613289 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86bc7fb0-98bd-453b-bc4b-35af3c9ba279 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:45.613743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-beec1a9d-d939-47c7-8f82-edaf1d3cd23d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:45.614338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86bc7fb0-98bd-453b-bc4b-35af3c9ba279 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:45.615407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86bc7fb0-98bd-453b-bc4b-35af3c9ba279 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:45.616380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86bc7fb0-98bd-453b-bc4b-35af3c9ba279 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:45.623417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-beec1a9d-d939-47c7-8f82-edaf1d3cd23d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.286891 Apr 19 03:42:45.624595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 320/685] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:45 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:45.665064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-b6e31280-6f23-411f-885a-1877ef99dd93 req-b329deae-7fe7-41ad-8643-67d568e29691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc5cf11-07e5-4749-b662-5d41fef38609", "name": "network-vif-plugged", "status": "completed", "tag": "fbdc9349-8214-499d-88ec-f32902245c65"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:45.667474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:42:45.667474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:42:45.680376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-b6e31280-6f23-411f-885a-1877ef99dd93 req-b329deae-7fe7-41ad-8643-67d568e29691 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:45.685802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-b6e31280-6f23-411f-885a-1877ef99dd93 req-b329deae-7fe7-41ad-8643-67d568e29691 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:45.701130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-b6e31280-6f23-411f-885a-1877ef99dd93 req-b329deae-7fe7-41ad-8643-67d568e29691 service nova] Creating event network-vif-plugged:fbdc9349-8214-499d-88ec-f32902245c65 for instance 3cc5cf11-07e5-4749-b662-5d41fef38609 on hv-cinder-78605 Apr 19 03:42:45.723880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-b6e31280-6f23-411f-885a-1877ef99dd93 req-b329deae-7fe7-41ad-8643-67d568e29691 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063836 Apr 19 03:42:45.726709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 321/686] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:42:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:42:45.885851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-86bc7fb0-98bd-453b-bc4b-35af3c9ba279 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:45.896984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-86bc7fb0-98bd-453b-bc4b-35af3c9ba279 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.301425 Apr 19 03:42:45.897937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 366/687] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:45 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:42:46.518916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-21fd752e-0845-414c-b4ff-f751a4756a5b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:46.519725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-21fd752e-0845-414c-b4ff-f751a4756a5b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:46.527803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21fd752e-0845-414c-b4ff-f751a4756a5b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:46.528308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21fd752e-0845-414c-b4ff-f751a4756a5b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:46.529141 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21fd752e-0845-414c-b4ff-f751a4756a5b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:46.529638 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21fd752e-0845-414c-b4ff-f751a4756a5b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:46.641868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-50b1f144-dbd2-4ce8-8f96-b549c8263dff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:46.645101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-50b1f144-dbd2-4ce8-8f96-b549c8263dff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:46.650648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50b1f144-dbd2-4ce8-8f96-b549c8263dff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:46.651395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50b1f144-dbd2-4ce8-8f96-b549c8263dff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:46.652235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50b1f144-dbd2-4ce8-8f96-b549c8263dff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:46.652730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50b1f144-dbd2-4ce8-8f96-b549c8263dff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:46.750735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-21fd752e-0845-414c-b4ff-f751a4756a5b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:46.763509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-21fd752e-0845-414c-b4ff-f751a4756a5b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:46.765731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-21fd752e-0845-414c-b4ff-f751a4756a5b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:46.767393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-21fd752e-0845-414c-b4ff-f751a4756a5b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.253029 Apr 19 03:42:46.779960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 322/688] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:46 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:46.879878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-50b1f144-dbd2-4ce8-8f96-b549c8263dff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:46.889300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-50b1f144-dbd2-4ce8-8f96-b549c8263dff tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.251619 Apr 19 03:42:46.890082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 367/689] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:46 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:42:46.916695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-266369e5-37a4-4583-beac-6619a49e33c1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:46.917371 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-266369e5-37a4-4583-beac-6619a49e33c1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:46.926014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-266369e5-37a4-4583-beac-6619a49e33c1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:46.926942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-266369e5-37a4-4583-beac-6619a49e33c1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:46.927904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-266369e5-37a4-4583-beac-6619a49e33c1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:46.928400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-266369e5-37a4-4583-beac-6619a49e33c1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:47.165475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-266369e5-37a4-4583-beac-6619a49e33c1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:47.174690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-266369e5-37a4-4583-beac-6619a49e33c1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1259 microversion: 2.1 time: 0.262163 Apr 19 03:42:47.175454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 323/690] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:46 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:47.762931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-fca69d8b-9540-4808-9720-406dd19bb92a req-39ca9258-4af5-4546-94d7-67f90c13f4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e2695b-dd12-444c-8d09-a65518f70b76", "name": "network-vif-plugged", "status": "completed", "tag": "cdee7d9f-4c20-4572-8d6d-32ffe46d4cfe"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:47.764925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:42:47.764925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:42:47.773767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-fca69d8b-9540-4808-9720-406dd19bb92a req-39ca9258-4af5-4546-94d7-67f90c13f4e2 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:47.774268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-fca69d8b-9540-4808-9720-406dd19bb92a req-39ca9258-4af5-4546-94d7-67f90c13f4e2 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:47.788958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2cdb7d84-0f5a-42f2-b005-5427f880c152 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:47.789610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2cdb7d84-0f5a-42f2-b005-5427f880c152 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:47.794911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-fca69d8b-9540-4808-9720-406dd19bb92a req-39ca9258-4af5-4546-94d7-67f90c13f4e2 service nova] Creating event network-vif-plugged:cdee7d9f-4c20-4572-8d6d-32ffe46d4cfe for instance b1e2695b-dd12-444c-8d09-a65518f70b76 on hv-cinder-78605 Apr 19 03:42:47.797791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cdb7d84-0f5a-42f2-b005-5427f880c152 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:47.798308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cdb7d84-0f5a-42f2-b005-5427f880c152 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:47.799169 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cdb7d84-0f5a-42f2-b005-5427f880c152 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:47.799667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cdb7d84-0f5a-42f2-b005-5427f880c152 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:47.800346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-fca69d8b-9540-4808-9720-406dd19bb92a req-39ca9258-4af5-4546-94d7-67f90c13f4e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041491 Apr 19 03:42:47.801292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 368/691] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:42:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:42:47.923487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-48756cc5-3f02-4134-b399-0c1fef1ec36d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:47.924632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-48756cc5-3f02-4134-b399-0c1fef1ec36d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:47.934190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48756cc5-3f02-4134-b399-0c1fef1ec36d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:47.934888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48756cc5-3f02-4134-b399-0c1fef1ec36d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:47.935952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48756cc5-3f02-4134-b399-0c1fef1ec36d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:47.936586 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48756cc5-3f02-4134-b399-0c1fef1ec36d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:48.032409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2cdb7d84-0f5a-42f2-b005-5427f880c152 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:48.045753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2cdb7d84-0f5a-42f2-b005-5427f880c152 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:48.047698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2cdb7d84-0f5a-42f2-b005-5427f880c152 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:48.049182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2cdb7d84-0f5a-42f2-b005-5427f880c152 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.264704 Apr 19 03:42:48.049944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 324/692] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:47 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:48.193138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-255aac02-2286-44de-a40e-d1225fc2edc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:48.194350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-255aac02-2286-44de-a40e-d1225fc2edc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:48.202296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-255aac02-2286-44de-a40e-d1225fc2edc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:48.202804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-255aac02-2286-44de-a40e-d1225fc2edc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:48.203678 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-255aac02-2286-44de-a40e-d1225fc2edc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:48.204177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-255aac02-2286-44de-a40e-d1225fc2edc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:48.221996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-48756cc5-3f02-4134-b399-0c1fef1ec36d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:48.235264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-48756cc5-3f02-4134-b399-0c1fef1ec36d tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1265 microversion: 2.1 time: 0.322860 Apr 19 03:42:48.237002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 369/693] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:47 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1265 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:48.427864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-255aac02-2286-44de-a40e-d1225fc2edc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:48.438233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-255aac02-2286-44de-a40e-d1225fc2edc0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1442 microversion: 2.1 time: 0.249179 Apr 19 03:42:48.439052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 325/694] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:48 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1442 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:42:48.456190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a26313e6-2b68-46f1-99d9-b1efb5a2f881 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:48.456891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a26313e6-2b68-46f1-99d9-b1efb5a2f881 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:48.465043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a26313e6-2b68-46f1-99d9-b1efb5a2f881 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:48.465553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a26313e6-2b68-46f1-99d9-b1efb5a2f881 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:48.466371 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a26313e6-2b68-46f1-99d9-b1efb5a2f881 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:48.466854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a26313e6-2b68-46f1-99d9-b1efb5a2f881 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:48.689908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a26313e6-2b68-46f1-99d9-b1efb5a2f881 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:48.699697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a26313e6-2b68-46f1-99d9-b1efb5a2f881 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1442 microversion: 2.1 time: 0.247650 Apr 19 03:42:48.700328 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 370/695] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:48 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1442 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:49.070684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4d0cd157-7c3b-478c-bae5-779f0087af14 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:49.072444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4d0cd157-7c3b-478c-bae5-779f0087af14 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:49.085590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d0cd157-7c3b-478c-bae5-779f0087af14 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:49.086497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d0cd157-7c3b-478c-bae5-779f0087af14 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:49.087529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d0cd157-7c3b-478c-bae5-779f0087af14 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:49.088346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d0cd157-7c3b-478c-bae5-779f0087af14 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:49.254146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-585ba1ad-2a3b-4cf4-b8f9-60032aecd40c tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:49.255908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-585ba1ad-2a3b-4cf4-b8f9-60032aecd40c tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:49.264102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-585ba1ad-2a3b-4cf4-b8f9-60032aecd40c tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:49.264937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-585ba1ad-2a3b-4cf4-b8f9-60032aecd40c tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:49.265941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-585ba1ad-2a3b-4cf4-b8f9-60032aecd40c tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:49.266637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-585ba1ad-2a3b-4cf4-b8f9-60032aecd40c tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:49.337050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4d0cd157-7c3b-478c-bae5-779f0087af14 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:49.356322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4d0cd157-7c3b-478c-bae5-779f0087af14 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:49.358992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4d0cd157-7c3b-478c-bae5-779f0087af14 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:49.360925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4d0cd157-7c3b-478c-bae5-779f0087af14 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.295516 Apr 19 03:42:49.373874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 326/696] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:49 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:49.948573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-585ba1ad-2a3b-4cf4-b8f9-60032aecd40c tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:49.958780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-585ba1ad-2a3b-4cf4-b8f9-60032aecd40c tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1452 microversion: 2.1 time: 0.708073 Apr 19 03:42:49.959720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 371/697] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:49 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1452 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:49.977210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-865a3281-0a2b-49c2-87d0-c97a0a838c17 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:49.977874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-865a3281-0a2b-49c2-87d0-c97a0a838c17 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:49.985892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-865a3281-0a2b-49c2-87d0-c97a0a838c17 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:49.988818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-865a3281-0a2b-49c2-87d0-c97a0a838c17 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:49.988818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-865a3281-0a2b-49c2-87d0-c97a0a838c17 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:49.988818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-865a3281-0a2b-49c2-87d0-c97a0a838c17 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:50.213190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-865a3281-0a2b-49c2-87d0-c97a0a838c17 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:50.222774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-865a3281-0a2b-49c2-87d0-c97a0a838c17 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1452 microversion: 2.1 time: 0.250690 Apr 19 03:42:50.223877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 327/698] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:49 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1452 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:42:50.381888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a7658c14-c132-404e-9bc8-cb87e7409649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:50.382607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a7658c14-c132-404e-9bc8-cb87e7409649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:50.390394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7658c14-c132-404e-9bc8-cb87e7409649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:50.391087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7658c14-c132-404e-9bc8-cb87e7409649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:50.392364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7658c14-c132-404e-9bc8-cb87e7409649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:50.393019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a7658c14-c132-404e-9bc8-cb87e7409649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:50.742906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a7658c14-c132-404e-9bc8-cb87e7409649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:50.758649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a7658c14-c132-404e-9bc8-cb87e7409649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:50.760467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a7658c14-c132-404e-9bc8-cb87e7409649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:50.765469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a7658c14-c132-404e-9bc8-cb87e7409649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.384541 Apr 19 03:42:50.765469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 372/699] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:50 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:51.601846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-e9f63da5-3240-4276-8bd4-548b88489b6f req-1e950dfb-b8ba-4a2e-9b1a-758386ce25a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29b14f0-f43c-434b-b583-cdf6b0e4b784", "name": "network-vif-plugged", "status": "completed", "tag": "8b1a69d0-ba1e-4994-b669-cc0e63d13b8b"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:51.603770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:42:51.603770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:42:51.613561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e9f63da5-3240-4276-8bd4-548b88489b6f req-1e950dfb-b8ba-4a2e-9b1a-758386ce25a0 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:51.614364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e9f63da5-3240-4276-8bd4-548b88489b6f req-1e950dfb-b8ba-4a2e-9b1a-758386ce25a0 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:51.633469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-e9f63da5-3240-4276-8bd4-548b88489b6f req-1e950dfb-b8ba-4a2e-9b1a-758386ce25a0 service nova] Creating event network-vif-plugged:8b1a69d0-ba1e-4994-b669-cc0e63d13b8b for instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 on hv-cinder-78605 Apr 19 03:42:51.639126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-e9f63da5-3240-4276-8bd4-548b88489b6f req-1e950dfb-b8ba-4a2e-9b1a-758386ce25a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041720 Apr 19 03:42:51.639798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 328/700] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:42:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:42:51.781870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4442f82f-b83a-44d8-af10-99c5d13dfc52 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:51.782541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4442f82f-b83a-44d8-af10-99c5d13dfc52 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:51.790592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4442f82f-b83a-44d8-af10-99c5d13dfc52 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:51.791095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4442f82f-b83a-44d8-af10-99c5d13dfc52 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:51.792063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4442f82f-b83a-44d8-af10-99c5d13dfc52 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:51.792555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4442f82f-b83a-44d8-af10-99c5d13dfc52 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:52.208970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4442f82f-b83a-44d8-af10-99c5d13dfc52 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:52.237834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4442f82f-b83a-44d8-af10-99c5d13dfc52 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:52.245600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4442f82f-b83a-44d8-af10-99c5d13dfc52 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:52.247404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4442f82f-b83a-44d8-af10-99c5d13dfc52 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.469784 Apr 19 03:42:52.248206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 373/701] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:51 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:52.472846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-64530057-a0fc-4679-873f-6712a9897965 req-3d8798d3-5ecc-45a6-ad02-8c6ff52d5d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc5cf11-07e5-4749-b662-5d41fef38609", "tag": "fbdc9349-8214-499d-88ec-f32902245c65"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:52.475312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:42:52.475312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:42:52.485867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-64530057-a0fc-4679-873f-6712a9897965 req-3d8798d3-5ecc-45a6-ad02-8c6ff52d5d39 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:52.486597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-64530057-a0fc-4679-873f-6712a9897965 req-3d8798d3-5ecc-45a6-ad02-8c6ff52d5d39 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:52.511556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-64530057-a0fc-4679-873f-6712a9897965 req-3d8798d3-5ecc-45a6-ad02-8c6ff52d5d39 service nova] Creating event network-changed:fbdc9349-8214-499d-88ec-f32902245c65 for instance 3cc5cf11-07e5-4749-b662-5d41fef38609 on hv-cinder-78605 Apr 19 03:42:52.522113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-64530057-a0fc-4679-873f-6712a9897965 req-3d8798d3-5ecc-45a6-ad02-8c6ff52d5d39 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051233 Apr 19 03:42:52.522113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 329/702] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:42:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:42:53.267997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cd480225-d900-405a-b3c6-30dbb49fb41f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:53.269435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cd480225-d900-405a-b3c6-30dbb49fb41f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:53.278214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd480225-d900-405a-b3c6-30dbb49fb41f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:53.279086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd480225-d900-405a-b3c6-30dbb49fb41f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:53.280034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd480225-d900-405a-b3c6-30dbb49fb41f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:53.280720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd480225-d900-405a-b3c6-30dbb49fb41f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:53.743865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-7eba350e-d588-4fea-9ed5-a531d32599bd req-84f7730a-b03a-4957-afb3-ba35d1a58661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e2695b-dd12-444c-8d09-a65518f70b76", "tag": "cdee7d9f-4c20-4572-8d6d-32ffe46d4cfe"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:53.746032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:42:53.746032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:42:53.746312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cd480225-d900-405a-b3c6-30dbb49fb41f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:53.767013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cd480225-d900-405a-b3c6-30dbb49fb41f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:53.768542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-7eba350e-d588-4fea-9ed5-a531d32599bd req-84f7730a-b03a-4957-afb3-ba35d1a58661 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:53.771218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-7eba350e-d588-4fea-9ed5-a531d32599bd req-84f7730a-b03a-4957-afb3-ba35d1a58661 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:53.774530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cd480225-d900-405a-b3c6-30dbb49fb41f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:53.777683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cd480225-d900-405a-b3c6-30dbb49fb41f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.513850 Apr 19 03:42:53.779656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 374/703] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:53 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:53.808394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-7eba350e-d588-4fea-9ed5-a531d32599bd req-84f7730a-b03a-4957-afb3-ba35d1a58661 service nova] Creating event network-changed:cdee7d9f-4c20-4572-8d6d-32ffe46d4cfe for instance b1e2695b-dd12-444c-8d09-a65518f70b76 on hv-cinder-78605 Apr 19 03:42:53.816832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-7eba350e-d588-4fea-9ed5-a531d32599bd req-84f7730a-b03a-4957-afb3-ba35d1a58661 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078492 Apr 19 03:42:53.818430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 330/704] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:42:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:42:54.800510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0feab812-5511-4f3b-8b33-b31ccfdb88df tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:54.801191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0feab812-5511-4f3b-8b33-b31ccfdb88df tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:54.811854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0feab812-5511-4f3b-8b33-b31ccfdb88df tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:54.812359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0feab812-5511-4f3b-8b33-b31ccfdb88df tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:54.813272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0feab812-5511-4f3b-8b33-b31ccfdb88df tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:54.814764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0feab812-5511-4f3b-8b33-b31ccfdb88df tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:55.225190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0feab812-5511-4f3b-8b33-b31ccfdb88df tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:55.237093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0feab812-5511-4f3b-8b33-b31ccfdb88df tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:55.239693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0feab812-5511-4f3b-8b33-b31ccfdb88df tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:55.241109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0feab812-5511-4f3b-8b33-b31ccfdb88df tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1808 microversion: 2.20 time: 0.446117 Apr 19 03:42:55.241898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 375/705] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:54 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1808 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:56.267681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-480811e5-5888-40a5-b5b9-65df08fb2b0b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:56.268504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-480811e5-5888-40a5-b5b9-65df08fb2b0b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:56.278646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-480811e5-5888-40a5-b5b9-65df08fb2b0b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:56.279173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-480811e5-5888-40a5-b5b9-65df08fb2b0b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:56.280043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-480811e5-5888-40a5-b5b9-65df08fb2b0b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:56.280539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-480811e5-5888-40a5-b5b9-65df08fb2b0b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:56.616266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-480811e5-5888-40a5-b5b9-65df08fb2b0b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:56.626429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-480811e5-5888-40a5-b5b9-65df08fb2b0b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:56.628138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-480811e5-5888-40a5-b5b9-65df08fb2b0b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:56.629360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-480811e5-5888-40a5-b5b9-65df08fb2b0b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1795 microversion: 2.20 time: 0.371761 Apr 19 03:42:56.630539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 331/706] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:42:56 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1795 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:42:59.144119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c3b5767c-9366-4279-8d7b-f44e021aa6bd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:59.144119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c3b5767c-9366-4279-8d7b-f44e021aa6bd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:59.156753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3b5767c-9366-4279-8d7b-f44e021aa6bd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:59.157260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3b5767c-9366-4279-8d7b-f44e021aa6bd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:59.158174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3b5767c-9366-4279-8d7b-f44e021aa6bd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:59.158584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3b5767c-9366-4279-8d7b-f44e021aa6bd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:59.223973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c3b5767c-9366-4279-8d7b-f44e021aa6bd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Going to try to terminate instance {{(pid=100591) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:42:59.291483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1055412164", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "networks": [{"uuid": "7501e78c-0338-4342-802f-4a47cedfcb41"}]}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:42:59.365245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] validate_networks() for [('7501e78c-0338-4342-802f-4a47cedfcb41', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:42:59.435216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c3b5767c-9366-4279-8d7b-f44e021aa6bd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 204 len: 0 microversion: 2.1 time: 0.295212 Apr 19 03:42:59.435982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 376/707] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:42:59 2021] DELETE /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:42:59.445024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-08669a63-c13e-44a0-aa22-9cf9d4bad067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:42:59.445789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-08669a63-c13e-44a0-aa22-9cf9d4bad067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:42:59.453690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08669a63-c13e-44a0-aa22-9cf9d4bad067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:59.454193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08669a63-c13e-44a0-aa22-9cf9d4bad067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:59.455073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08669a63-c13e-44a0-aa22-9cf9d4bad067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:59.455632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08669a63-c13e-44a0-aa22-9cf9d4bad067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:59.678603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-08669a63-c13e-44a0-aa22-9cf9d4bad067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:42:59.687828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-08669a63-c13e-44a0-aa22-9cf9d4bad067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1672 microversion: 2.1 time: 0.247220 Apr 19 03:42:59.688451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 377/708] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:42:59 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:42:59.975027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:42:59.975535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:42:59.976083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:42:59.976541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:42:59.977001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:42:59.985865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:59.986367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:42:59.987523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:42:59.988009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:00.006689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Getting quotas for project 31bc321f6ebe4f21af7ed85906e23ca7. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:43:00.010972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Getting quotas for user 9c52bd46007e4ac6b6d4091a798424c6 and project 31bc321f6ebe4f21af7ed85906e23ca7. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:43:00.022640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:43:00.025256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:43:00.130222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0fd8dfc2-dd9e-4e11-b0bf-636b338e6bc1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842307 Apr 19 03:43:00.130866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 332/709] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:42:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 19 03:43:00.141665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bd83bae9-f3d0-4974-80bd-afd9876c413e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:00.142460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bd83bae9-f3d0-4974-80bd-afd9876c413e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:00.220657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bd83bae9-f3d0-4974-80bd-afd9876c413e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:00.229203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bd83bae9-f3d0-4974-80bd-afd9876c413e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1219 microversion: 2.1 time: 0.091503 Apr 19 03:43:00.229825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 378/710] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:00 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:00.706375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-596d2186-524e-423a-8aeb-2749d0a10b12 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:00.706987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-596d2186-524e-423a-8aeb-2749d0a10b12 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:00.714896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-596d2186-524e-423a-8aeb-2749d0a10b12 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:00.715455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-596d2186-524e-423a-8aeb-2749d0a10b12 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:00.716261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-596d2186-524e-423a-8aeb-2749d0a10b12 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:00.716743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-596d2186-524e-423a-8aeb-2749d0a10b12 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:00.930365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-596d2186-524e-423a-8aeb-2749d0a10b12 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:00.939255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-596d2186-524e-423a-8aeb-2749d0a10b12 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1672 microversion: 2.1 time: 0.237189 Apr 19 03:43:00.939877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 333/711] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:00 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1672 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:01.246799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-adc6afcf-dbbd-4870-8b6f-15153fedf5a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:01.247610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-adc6afcf-dbbd-4870-8b6f-15153fedf5a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:01.259298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc6afcf-dbbd-4870-8b6f-15153fedf5a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:01.259813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc6afcf-dbbd-4870-8b6f-15153fedf5a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:01.260637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc6afcf-dbbd-4870-8b6f-15153fedf5a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:01.261123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc6afcf-dbbd-4870-8b6f-15153fedf5a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:01.381705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-adc6afcf-dbbd-4870-8b6f-15153fedf5a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:01.390305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-adc6afcf-dbbd-4870-8b6f-15153fedf5a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1223 microversion: 2.1 time: 0.147411 Apr 19 03:43:01.390915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 379/712] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:01 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1223 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:01.957321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1fbb8cc5-b408-430b-8410-bc6630b9fe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:01.957991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1fbb8cc5-b408-430b-8410-bc6630b9fe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:01.966465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1fbb8cc5-b408-430b-8410-bc6630b9fe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:01.966971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1fbb8cc5-b408-430b-8410-bc6630b9fe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:01.967826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1fbb8cc5-b408-430b-8410-bc6630b9fe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:01.968317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1fbb8cc5-b408-430b-8410-bc6630b9fe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:02.174037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1fbb8cc5-b408-430b-8410-bc6630b9fe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:02.183312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1fbb8cc5-b408-430b-8410-bc6630b9fe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1672 microversion: 2.1 time: 0.230063 Apr 19 03:43:02.183936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 334/713] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:01 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1672 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:02.408881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-84404846-2af8-43a5-bae4-aaddb64d2da8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:02.409556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-84404846-2af8-43a5-bae4-aaddb64d2da8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:02.417695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84404846-2af8-43a5-bae4-aaddb64d2da8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:02.418204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84404846-2af8-43a5-bae4-aaddb64d2da8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:02.419092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84404846-2af8-43a5-bae4-aaddb64d2da8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:02.419636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84404846-2af8-43a5-bae4-aaddb64d2da8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:02.668476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-84404846-2af8-43a5-bae4-aaddb64d2da8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:02.677214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-84404846-2af8-43a5-bae4-aaddb64d2da8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1215 microversion: 2.1 time: 0.272440 Apr 19 03:43:02.678525 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 380/714] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:02 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:03.202385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-59d74b04-85e5-433c-813e-f15a727ec087 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:03.203060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-59d74b04-85e5-433c-813e-f15a727ec087 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:03.211608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-59d74b04-85e5-433c-813e-f15a727ec087 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:03.212118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-59d74b04-85e5-433c-813e-f15a727ec087 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:03.212941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-59d74b04-85e5-433c-813e-f15a727ec087 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:03.213431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-59d74b04-85e5-433c-813e-f15a727ec087 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:03.483755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-59d74b04-85e5-433c-813e-f15a727ec087 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:03.493074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-59d74b04-85e5-433c-813e-f15a727ec087 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1672 microversion: 2.1 time: 0.294907 Apr 19 03:43:03.493699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 335/715] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:03 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1672 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:03.697102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-635f924d-1602-449f-a8f0-fe272ea7ec01 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:03.697859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-635f924d-1602-449f-a8f0-fe272ea7ec01 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:03.706001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-635f924d-1602-449f-a8f0-fe272ea7ec01 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:03.706739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-635f924d-1602-449f-a8f0-fe272ea7ec01 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:03.707702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-635f924d-1602-449f-a8f0-fe272ea7ec01 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:03.708396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-635f924d-1602-449f-a8f0-fe272ea7ec01 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:03.910813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-635f924d-1602-449f-a8f0-fe272ea7ec01 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:03.920980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-635f924d-1602-449f-a8f0-fe272ea7ec01 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1289 microversion: 2.1 time: 0.229840 Apr 19 03:43:03.921765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 381/716] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:03 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1289 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:04.511297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-54397607-e34a-4a92-9fac-77423f3d43b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:04.512130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-54397607-e34a-4a92-9fac-77423f3d43b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:04.520079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54397607-e34a-4a92-9fac-77423f3d43b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:04.520814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54397607-e34a-4a92-9fac-77423f3d43b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:04.522795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54397607-e34a-4a92-9fac-77423f3d43b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:04.522947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54397607-e34a-4a92-9fac-77423f3d43b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:04.754786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-54397607-e34a-4a92-9fac-77423f3d43b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:04.764264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-54397607-e34a-4a92-9fac-77423f3d43b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1672 microversion: 2.1 time: 0.257129 Apr 19 03:43:04.764890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 336/717] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:04 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1672 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:04.939694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f0e01a73-9ba9-417d-88ee-d5eee89cbc03 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:04.940374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f0e01a73-9ba9-417d-88ee-d5eee89cbc03 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:04.948753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0e01a73-9ba9-417d-88ee-d5eee89cbc03 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:04.949268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0e01a73-9ba9-417d-88ee-d5eee89cbc03 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:04.950106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0e01a73-9ba9-417d-88ee-d5eee89cbc03 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:04.950598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0e01a73-9ba9-417d-88ee-d5eee89cbc03 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:05.121379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f0e01a73-9ba9-417d-88ee-d5eee89cbc03 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:05.130312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f0e01a73-9ba9-417d-88ee-d5eee89cbc03 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1277 microversion: 2.1 time: 0.194746 Apr 19 03:43:05.131489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 382/718] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:04 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:05.783081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-997ff902-18be-4b12-a0c3-562502165630 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:05.784563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-997ff902-18be-4b12-a0c3-562502165630 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:05.792943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-997ff902-18be-4b12-a0c3-562502165630 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:05.793460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-997ff902-18be-4b12-a0c3-562502165630 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:05.794356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-997ff902-18be-4b12-a0c3-562502165630 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:05.794851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-997ff902-18be-4b12-a0c3-562502165630 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:05.931266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-997ff902-18be-4b12-a0c3-562502165630 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:05.940834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-997ff902-18be-4b12-a0c3-562502165630 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 200 len: 1605 microversion: 2.1 time: 0.162026 Apr 19 03:43:05.941379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 337/719] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:05 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:06.044078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-dbaf3bd9-c82e-4237-ad92-5fa99027722c req-5f23a37e-f854-49ba-8f97-723d9c04c12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8953516a-dcec-4e76-92a9-9a8f25e24014", "name": "network-vif-deleted", "tag": "ecbdac77-18ba-4113-9f8c-ba2c61c4047b"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:06.045911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:43:06.045911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:43:06.055762 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-dbaf3bd9-c82e-4237-ad92-5fa99027722c req-5f23a37e-f854-49ba-8f97-723d9c04c12e service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:06.059683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-dbaf3bd9-c82e-4237-ad92-5fa99027722c req-5f23a37e-f854-49ba-8f97-723d9c04c12e service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:06.076664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-dbaf3bd9-c82e-4237-ad92-5fa99027722c req-5f23a37e-f854-49ba-8f97-723d9c04c12e service nova] Creating event network-vif-deleted:ecbdac77-18ba-4113-9f8c-ba2c61c4047b for instance 8953516a-dcec-4e76-92a9-9a8f25e24014 on hv-cinder-78605 Apr 19 03:43:06.085253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-dbaf3bd9-c82e-4237-ad92-5fa99027722c req-5f23a37e-f854-49ba-8f97-723d9c04c12e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044940 Apr 19 03:43:06.086172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 383/720] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:43:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:43:06.148409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c8a0bdcb-c13b-4fa4-b858-de47467892f4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:06.149335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c8a0bdcb-c13b-4fa4-b858-de47467892f4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:06.167361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8a0bdcb-c13b-4fa4-b858-de47467892f4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:06.168112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8a0bdcb-c13b-4fa4-b858-de47467892f4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:06.169129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8a0bdcb-c13b-4fa4-b858-de47467892f4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:06.169762 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8a0bdcb-c13b-4fa4-b858-de47467892f4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:06.455575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c8a0bdcb-c13b-4fa4-b858-de47467892f4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:06.465632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c8a0bdcb-c13b-4fa4-b858-de47467892f4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1319 microversion: 2.1 time: 0.321272 Apr 19 03:43:06.466598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 338/721] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:06 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:06.964786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-80097020-8104-465a-9aa2-80933f50e817 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:06.966217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-80097020-8104-465a-9aa2-80933f50e817 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:06.987695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-80097020-8104-465a-9aa2-80933f50e817 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:06.988954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-80097020-8104-465a-9aa2-80933f50e817 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:06.989825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-80097020-8104-465a-9aa2-80933f50e817 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:06.991213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-80097020-8104-465a-9aa2-80933f50e817 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:07.048981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-80097020-8104-465a-9aa2-80933f50e817 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] HTTP exception thrown: Instance 8953516a-dcec-4e76-92a9-9a8f25e24014 could not be found. Apr 19 03:43:07.049661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-80097020-8104-465a-9aa2-80933f50e817 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Returning 404 to user: Instance 8953516a-dcec-4e76-92a9-9a8f25e24014 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:43:07.050575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-80097020-8104-465a-9aa2-80933f50e817 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 404 len: 111 microversion: 2.1 time: 0.094563 Apr 19 03:43:07.051192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 384/722] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:06 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:43:07.060658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1c7e02d1-c4f7-4cef-ac0e-d32513dfb1dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '.version_select at 0x7f9dac476c80>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:07.163682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1c7e02d1-c4f7-4cef-ac0e-d32513dfb1dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112102942" status: 202 len: 0 microversion: 2.1 time: 0.106927 Apr 19 03:43:07.165529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 339/723] 10.222.0.25 () {58 vars in 1211 bytes} [Mon Apr 19 03:43:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112102942 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:43:07.492921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-54aa2f82-3332-47dd-bd1b-29db11e80045 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:07.493909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-54aa2f82-3332-47dd-bd1b-29db11e80045 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:07.504464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54aa2f82-3332-47dd-bd1b-29db11e80045 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:07.505241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54aa2f82-3332-47dd-bd1b-29db11e80045 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:07.506351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54aa2f82-3332-47dd-bd1b-29db11e80045 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:07.507043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54aa2f82-3332-47dd-bd1b-29db11e80045 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:08.107280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-12bc0187-9556-4d74-9858-a325d2dd6c96 req-cc8be441-a040-49ff-be5d-149bcee4fdaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f609b2-0123-4d89-bdad-5cc7cf50f86c", "tag": "0de7e94e-e1d6-4305-98e5-e0bd85a974fb"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:08.110028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:43:08.110028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:43:08.124402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-12bc0187-9556-4d74-9858-a325d2dd6c96 req-cc8be441-a040-49ff-be5d-149bcee4fdaa service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:08.125189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-12bc0187-9556-4d74-9858-a325d2dd6c96 req-cc8be441-a040-49ff-be5d-149bcee4fdaa service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:08.151433 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-12bc0187-9556-4d74-9858-a325d2dd6c96 req-cc8be441-a040-49ff-be5d-149bcee4fdaa service nova] Creating event network-changed:0de7e94e-e1d6-4305-98e5-e0bd85a974fb for instance c6f609b2-0123-4d89-bdad-5cc7cf50f86c on hv-cinder-78605 Apr 19 03:43:08.157321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-12bc0187-9556-4d74-9858-a325d2dd6c96 req-cc8be441-a040-49ff-be5d-149bcee4fdaa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054091 Apr 19 03:43:08.158522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 340/724] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:43:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:43:08.304791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-54aa2f82-3332-47dd-bd1b-29db11e80045 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:08.314828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-54aa2f82-3332-47dd-bd1b-29db11e80045 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1319 microversion: 2.1 time: 0.830651 Apr 19 03:43:08.316554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 385/725] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:07 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1319 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:08.808618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1613fbb0-2173-47a8-b8fa-2f5d9d20bbe6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'create', calling method: .version_select at 0x7f9db100a9d8>, body: {"keypair": {"name": "tempest-keypair-1710261813"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:08.833679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-1613fbb0-2173-47a8-b8fa-2f5d9d20bbe6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for project 2853b10cb882499b9bb1d15de040c189. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:43:08.837845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-1613fbb0-2173-47a8-b8fa-2f5d9d20bbe6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for user fe48ae85de1643bc82155a724a28eb93 and project 2853b10cb882499b9bb1d15de040c189. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:43:09.335546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-510e8481-30f2-49ae-a2bf-86feae16f6f0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:09.336341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-510e8481-30f2-49ae-a2bf-86feae16f6f0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:09.344435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-510e8481-30f2-49ae-a2bf-86feae16f6f0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:09.344953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-510e8481-30f2-49ae-a2bf-86feae16f6f0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:09.345790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-510e8481-30f2-49ae-a2bf-86feae16f6f0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:09.346456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-510e8481-30f2-49ae-a2bf-86feae16f6f0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:09.368775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-1613fbb0-2173-47a8-b8fa-2f5d9d20bbe6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for project 2853b10cb882499b9bb1d15de040c189. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:43:09.373070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-1613fbb0-2173-47a8-b8fa-2f5d9d20bbe6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for user fe48ae85de1643bc82155a724a28eb93 and project 2853b10cb882499b9bb1d15de040c189. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:43:09.386988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1613fbb0-2173-47a8-b8fa-2f5d9d20bbe6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.582942 Apr 19 03:43:09.387730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 341/726] 10.222.0.25 () {60 vars in 1148 bytes} [Mon Apr 19 03:43:08 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:09.572982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-510e8481-30f2-49ae-a2bf-86feae16f6f0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:09.582870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-510e8481-30f2-49ae-a2bf-86feae16f6f0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1319 microversion: 2.1 time: 0.252674 Apr 19 03:43:09.583555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 386/727] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:09 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:10.604106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-27a51543-c3ca-4de6-817f-dd1f0d3cb975 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:10.605552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-27a51543-c3ca-4de6-817f-dd1f0d3cb975 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:10.616439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27a51543-c3ca-4de6-817f-dd1f0d3cb975 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:10.617034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27a51543-c3ca-4de6-817f-dd1f0d3cb975 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:10.617983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27a51543-c3ca-4de6-817f-dd1f0d3cb975 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:10.618556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27a51543-c3ca-4de6-817f-dd1f0d3cb975 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:11.006671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-27a51543-c3ca-4de6-817f-dd1f0d3cb975 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:11.015715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-27a51543-c3ca-4de6-817f-dd1f0d3cb975 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1319 microversion: 2.1 time: 0.417829 Apr 19 03:43:11.016578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 342/728] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:10 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:11.962236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-901416652", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43cd66f9-03bd-414d-9d21-4899787c829e"}], "security_groups": [{"name": "tempest-securitygroup--1236551820"}], "key_name": "tempest-keypair-1710261813", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:12.034539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1f76aba8-13fd-4be3-b65d-a8417ec5fe1d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:12.035479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1f76aba8-13fd-4be3-b65d-a8417ec5fe1d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:12.044050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f76aba8-13fd-4be3-b65d-a8417ec5fe1d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:12.044662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f76aba8-13fd-4be3-b65d-a8417ec5fe1d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:12.045547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f76aba8-13fd-4be3-b65d-a8417ec5fe1d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:12.046042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f76aba8-13fd-4be3-b65d-a8417ec5fe1d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:12.143067 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] validate_networks() for [('43cd66f9-03bd-414d-9d21-4899787c829e', None, None, None)] {{(pid=100591) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:43:12.269730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1f76aba8-13fd-4be3-b65d-a8417ec5fe1d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:12.280629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1f76aba8-13fd-4be3-b65d-a8417ec5fe1d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1319 microversion: 2.1 time: 0.250385 Apr 19 03:43:12.291315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 343/729] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:12 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:43:13.067233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Flavor limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:43:13.068062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Image limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:43:13.068760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Flavor pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:43:13.069454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Image pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:43:13.070063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:43:13.079430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:13.080237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:13.081176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:13.081736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:13.100916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for project 2853b10cb882499b9bb1d15de040c189. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:43:13.105297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Getting quotas for user fe48ae85de1643bc82155a724a28eb93 and project 2853b10cb882499b9bb1d15de040c189. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:43:13.117383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Going to run 1 instances... {{(pid=100591) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:43:13.120151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:43:13.201620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2ad505e5-ac86-4d76-9eff-3e34a23c3f4b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.244366 Apr 19 03:43:13.210591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 387/730] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:43:11 2021] POST /compute/v2.1/servers => generated 402 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:43:13.222616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-af1df554-ca05-4c17-8605-43d91d52b628 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:13.223662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-af1df554-ca05-4c17-8605-43d91d52b628 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:13.298107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b64ed287-4642-4cae-a2da-f30be68e77b2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:13.298943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b64ed287-4642-4cae-a2da-f30be68e77b2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:13.307922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b64ed287-4642-4cae-a2da-f30be68e77b2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:13.308719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b64ed287-4642-4cae-a2da-f30be68e77b2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:13.309809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b64ed287-4642-4cae-a2da-f30be68e77b2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:13.310490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b64ed287-4642-4cae-a2da-f30be68e77b2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:13.378778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-af1df554-ca05-4c17-8605-43d91d52b628 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:13.388602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-af1df554-ca05-4c17-8605-43d91d52b628 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1237 microversion: 2.1 time: 0.171434 Apr 19 03:43:13.389573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 344/731] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:13 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1237 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:13.558422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b64ed287-4642-4cae-a2da-f30be68e77b2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:13.572091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b64ed287-4642-4cae-a2da-f30be68e77b2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1319 microversion: 2.1 time: 0.277867 Apr 19 03:43:13.572906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 388/732] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:13 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:13.867232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-4178558f-4803-415a-8ff9-97d7780d8ad6 req-b93644e9-5abb-4769-8684-48cc6abaaaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f609b2-0123-4d89-bdad-5cc7cf50f86c", "name": "network-vif-plugged", "status": "completed", "tag": "0de7e94e-e1d6-4305-98e5-e0bd85a974fb"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:13.869431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:43:13.869431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:43:13.880954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-4178558f-4803-415a-8ff9-97d7780d8ad6 req-b93644e9-5abb-4769-8684-48cc6abaaaba service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:13.881943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-4178558f-4803-415a-8ff9-97d7780d8ad6 req-b93644e9-5abb-4769-8684-48cc6abaaaba service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:13.902754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-4178558f-4803-415a-8ff9-97d7780d8ad6 req-b93644e9-5abb-4769-8684-48cc6abaaaba service nova] Creating event network-vif-plugged:0de7e94e-e1d6-4305-98e5-e0bd85a974fb for instance c6f609b2-0123-4d89-bdad-5cc7cf50f86c on hv-cinder-78605 Apr 19 03:43:13.909189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-4178558f-4803-415a-8ff9-97d7780d8ad6 req-b93644e9-5abb-4769-8684-48cc6abaaaba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046094 Apr 19 03:43:13.911177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 345/733] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:43:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:43:14.406567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7726eae8-6124-4adc-940f-5e48cd95ac89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:14.407398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7726eae8-6124-4adc-940f-5e48cd95ac89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:14.415281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7726eae8-6124-4adc-940f-5e48cd95ac89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:14.415831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7726eae8-6124-4adc-940f-5e48cd95ac89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:14.416674 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7726eae8-6124-4adc-940f-5e48cd95ac89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:14.417166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7726eae8-6124-4adc-940f-5e48cd95ac89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:14.593763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7726eae8-6124-4adc-940f-5e48cd95ac89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:14.602535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-67638382-8503-45d6-8ed3-f9a596802362 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:14.603532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-67638382-8503-45d6-8ed3-f9a596802362 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:14.614240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7726eae8-6124-4adc-940f-5e48cd95ac89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1233 microversion: 2.1 time: 0.211980 Apr 19 03:43:14.615746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67638382-8503-45d6-8ed3-f9a596802362 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:14.616217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 389/734] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:14 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1233 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:14.618128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67638382-8503-45d6-8ed3-f9a596802362 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:14.619007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67638382-8503-45d6-8ed3-f9a596802362 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:14.619795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-67638382-8503-45d6-8ed3-f9a596802362 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:15.121288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-67638382-8503-45d6-8ed3-f9a596802362 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:15.130940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-67638382-8503-45d6-8ed3-f9a596802362 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1319 microversion: 2.1 time: 0.543345 Apr 19 03:43:15.131599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 346/735] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:14 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:15.633935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1a55d35a-45b7-464b-a4c5-ae119f741ae8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:15.636425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1a55d35a-45b7-464b-a4c5-ae119f741ae8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:15.646287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1a55d35a-45b7-464b-a4c5-ae119f741ae8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:15.647079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1a55d35a-45b7-464b-a4c5-ae119f741ae8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:15.648167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1a55d35a-45b7-464b-a4c5-ae119f741ae8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:15.648942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1a55d35a-45b7-464b-a4c5-ae119f741ae8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:15.822570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1a55d35a-45b7-464b-a4c5-ae119f741ae8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:15.848116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1a55d35a-45b7-464b-a4c5-ae119f741ae8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1307 microversion: 2.1 time: 0.204175 Apr 19 03:43:15.848116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 390/736] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:15 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:16.149790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d9feb218-2e54-42e8-bfdd-f2506630bf75 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:16.150942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d9feb218-2e54-42e8-bfdd-f2506630bf75 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:16.159265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d9feb218-2e54-42e8-bfdd-f2506630bf75 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:16.160051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d9feb218-2e54-42e8-bfdd-f2506630bf75 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:16.161124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d9feb218-2e54-42e8-bfdd-f2506630bf75 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:16.161704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d9feb218-2e54-42e8-bfdd-f2506630bf75 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:16.854104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ed066a89-e6a1-4c74-9388-88a7698725b2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:16.855367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ed066a89-e6a1-4c74-9388-88a7698725b2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:16.863773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ed066a89-e6a1-4c74-9388-88a7698725b2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:16.864202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ed066a89-e6a1-4c74-9388-88a7698725b2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:16.865837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ed066a89-e6a1-4c74-9388-88a7698725b2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:16.866492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ed066a89-e6a1-4c74-9388-88a7698725b2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:17.039838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d9feb218-2e54-42e8-bfdd-f2506630bf75 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:17.051815 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d9feb218-2e54-42e8-bfdd-f2506630bf75 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1509 microversion: 2.1 time: 0.906874 Apr 19 03:43:17.064953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 347/737] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:16 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1509 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:17.686282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ed066a89-e6a1-4c74-9388-88a7698725b2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:17.697903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ed066a89-e6a1-4c74-9388-88a7698725b2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1363 microversion: 2.1 time: 0.847712 Apr 19 03:43:17.698518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 391/738] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:16 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1363 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:18.534368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-79cc0bcf-4794-433c-8be9-c660ef68a491 req-99099089-48a8-4378-94f5-832cfcb12fcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0656c7c5-439a-47a8-ab73-8a5e4e007bbd", "tag": "f83c1559-bd4d-464d-a64e-211ac4f14239"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:18.537913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:43:18.537913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:43:18.569030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-79cc0bcf-4794-433c-8be9-c660ef68a491 req-99099089-48a8-4378-94f5-832cfcb12fcf service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:18.571827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-79cc0bcf-4794-433c-8be9-c660ef68a491 req-99099089-48a8-4378-94f5-832cfcb12fcf service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:18.620351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-79cc0bcf-4794-433c-8be9-c660ef68a491 req-99099089-48a8-4378-94f5-832cfcb12fcf service nova] Creating event network-changed:f83c1559-bd4d-464d-a64e-211ac4f14239 for instance 0656c7c5-439a-47a8-ab73-8a5e4e007bbd on hv-cinder-78605 Apr 19 03:43:18.628253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-79cc0bcf-4794-433c-8be9-c660ef68a491 req-99099089-48a8-4378-94f5-832cfcb12fcf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098729 Apr 19 03:43:18.631604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 348/739] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:43:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:43:18.717985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-107e622d-33d7-4df8-a1d1-8a24c03ba1bc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:18.718691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-107e622d-33d7-4df8-a1d1-8a24c03ba1bc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:18.727999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-107e622d-33d7-4df8-a1d1-8a24c03ba1bc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:18.728599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-107e622d-33d7-4df8-a1d1-8a24c03ba1bc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:18.729507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-107e622d-33d7-4df8-a1d1-8a24c03ba1bc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:18.731911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-107e622d-33d7-4df8-a1d1-8a24c03ba1bc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:19.178887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-107e622d-33d7-4df8-a1d1-8a24c03ba1bc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:19.188009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-107e622d-33d7-4df8-a1d1-8a24c03ba1bc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1363 microversion: 2.1 time: 0.475902 Apr 19 03:43:19.188645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 392/740] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:18 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1363 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:20.208881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9b684807-400c-4d60-8a34-d6e7ac026bfe tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:20.210385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9b684807-400c-4d60-8a34-d6e7ac026bfe tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:20.227737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b684807-400c-4d60-8a34-d6e7ac026bfe tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:20.229834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b684807-400c-4d60-8a34-d6e7ac026bfe tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:20.230612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b684807-400c-4d60-8a34-d6e7ac026bfe tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:20.231769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b684807-400c-4d60-8a34-d6e7ac026bfe tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:20.625941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9b684807-400c-4d60-8a34-d6e7ac026bfe tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:20.636937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9b684807-400c-4d60-8a34-d6e7ac026bfe tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1363 microversion: 2.1 time: 0.433456 Apr 19 03:43:20.638186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 349/741] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:20 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:21.929011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6b56448a-3623-4f98-b675-dcd14ab11544 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:21.929670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6b56448a-3623-4f98-b675-dcd14ab11544 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:21.937869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b56448a-3623-4f98-b675-dcd14ab11544 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:21.939984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b56448a-3623-4f98-b675-dcd14ab11544 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:21.939984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b56448a-3623-4f98-b675-dcd14ab11544 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:21.939984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b56448a-3623-4f98-b675-dcd14ab11544 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:22.881664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6b56448a-3623-4f98-b675-dcd14ab11544 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:22.892814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6b56448a-3623-4f98-b675-dcd14ab11544 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1363 microversion: 2.1 time: 1.240626 Apr 19 03:43:22.893823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 393/742] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:21 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1363 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:23.912558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e5dae328-a93b-4081-ba0e-18a7339e4f64 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:23.913912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e5dae328-a93b-4081-ba0e-18a7339e4f64 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:23.937588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5dae328-a93b-4081-ba0e-18a7339e4f64 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:23.937588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5dae328-a93b-4081-ba0e-18a7339e4f64 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:23.944115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5dae328-a93b-4081-ba0e-18a7339e4f64 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:23.944717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5dae328-a93b-4081-ba0e-18a7339e4f64 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:24.241886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e5dae328-a93b-4081-ba0e-18a7339e4f64 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:24.252945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e5dae328-a93b-4081-ba0e-18a7339e4f64 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1363 microversion: 2.1 time: 0.345388 Apr 19 03:43:24.253991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 350/743] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:23 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:25.275645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0707bf21-9328-4222-8823-35c5c36b15ae tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:25.288636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0707bf21-9328-4222-8823-35c5c36b15ae tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:25.298102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0707bf21-9328-4222-8823-35c5c36b15ae tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:25.299316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0707bf21-9328-4222-8823-35c5c36b15ae tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:25.303951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0707bf21-9328-4222-8823-35c5c36b15ae tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:25.303951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0707bf21-9328-4222-8823-35c5c36b15ae tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:25.902838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0707bf21-9328-4222-8823-35c5c36b15ae tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:25.919260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0707bf21-9328-4222-8823-35c5c36b15ae tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1363 microversion: 2.1 time: 0.651651 Apr 19 03:43:25.922163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 394/744] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:25 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1363 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:26.132757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-2629d420-2616-4e8b-90db-503ebd5814d9 req-2ddfebe0-ba50-4f1b-a968-860185ab539f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0656c7c5-439a-47a8-ab73-8a5e4e007bbd", "name": "network-vif-plugged", "status": "completed", "tag": "f83c1559-bd4d-464d-a64e-211ac4f14239"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:26.134553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:43:26.134553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:43:26.143914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-2629d420-2616-4e8b-90db-503ebd5814d9 req-2ddfebe0-ba50-4f1b-a968-860185ab539f service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:26.144444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-2629d420-2616-4e8b-90db-503ebd5814d9 req-2ddfebe0-ba50-4f1b-a968-860185ab539f service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:26.162987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-2629d420-2616-4e8b-90db-503ebd5814d9 req-2ddfebe0-ba50-4f1b-a968-860185ab539f service nova] Creating event network-vif-plugged:f83c1559-bd4d-464d-a64e-211ac4f14239 for instance 0656c7c5-439a-47a8-ab73-8a5e4e007bbd on hv-cinder-78605 Apr 19 03:43:26.169114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-2629d420-2616-4e8b-90db-503ebd5814d9 req-2ddfebe0-ba50-4f1b-a968-860185ab539f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041779 Apr 19 03:43:26.169962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 351/745] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:43:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:43:26.941615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fb1c4f69-1e22-438f-ac5a-5e11b61f5899 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:26.943731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fb1c4f69-1e22-438f-ac5a-5e11b61f5899 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:26.952303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb1c4f69-1e22-438f-ac5a-5e11b61f5899 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:26.952811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb1c4f69-1e22-438f-ac5a-5e11b61f5899 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:26.953854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb1c4f69-1e22-438f-ac5a-5e11b61f5899 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:26.954359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb1c4f69-1e22-438f-ac5a-5e11b61f5899 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:27.623124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fb1c4f69-1e22-438f-ac5a-5e11b61f5899 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:27.632544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fb1c4f69-1e22-438f-ac5a-5e11b61f5899 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1363 microversion: 2.1 time: 0.695169 Apr 19 03:43:27.633500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 395/746] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:26 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1363 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:28.661693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-045eb6a0-0ee3-450c-85e8-1ddac5ccb9d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:28.663212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-045eb6a0-0ee3-450c-85e8-1ddac5ccb9d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:28.672331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-045eb6a0-0ee3-450c-85e8-1ddac5ccb9d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:28.673096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-045eb6a0-0ee3-450c-85e8-1ddac5ccb9d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:28.674196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-045eb6a0-0ee3-450c-85e8-1ddac5ccb9d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:28.674863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-045eb6a0-0ee3-450c-85e8-1ddac5ccb9d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:28.909953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-045eb6a0-0ee3-450c-85e8-1ddac5ccb9d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:28.920602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-045eb6a0-0ee3-450c-85e8-1ddac5ccb9d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1549 microversion: 2.1 time: 0.263194 Apr 19 03:43:28.931224 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 352/747] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:28 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1549 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:28.938794 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-88a354e5-117e-455a-9f0d-a4214fe520dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:28.939307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-88a354e5-117e-455a-9f0d-a4214fe520dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:28.947273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88a354e5-117e-455a-9f0d-a4214fe520dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:28.947834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88a354e5-117e-455a-9f0d-a4214fe520dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:28.948677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88a354e5-117e-455a-9f0d-a4214fe520dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:28.949171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-88a354e5-117e-455a-9f0d-a4214fe520dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:29.238963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-88a354e5-117e-455a-9f0d-a4214fe520dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.304290 Apr 19 03:43:29.239678 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 396/748] 10.222.0.25 () {58 vars in 1265 bytes} [Mon Apr 19 03:43:28 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-interface => generated 285 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:43:31.325744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6281b0af-9287-41fc-8f2d-597c6639e337 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:31.326793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6281b0af-9287-41fc-8f2d-597c6639e337 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:31.338512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6281b0af-9287-41fc-8f2d-597c6639e337 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:31.339020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6281b0af-9287-41fc-8f2d-597c6639e337 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:31.339894 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6281b0af-9287-41fc-8f2d-597c6639e337 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:31.340388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6281b0af-9287-41fc-8f2d-597c6639e337 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:31.400821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-48861ee6-91d9-40ef-a381-eb4c3fac2fc5 req-e94408cc-1d31-4de8-a74d-ba00f9054bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0656c7c5-439a-47a8-ab73-8a5e4e007bbd", "tag": "f83c1559-bd4d-464d-a64e-211ac4f14239"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:31.405869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:43:31.405869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:43:31.418588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-48861ee6-91d9-40ef-a381-eb4c3fac2fc5 req-e94408cc-1d31-4de8-a74d-ba00f9054bf2 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:31.419413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-48861ee6-91d9-40ef-a381-eb4c3fac2fc5 req-e94408cc-1d31-4de8-a74d-ba00f9054bf2 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:31.439251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-48861ee6-91d9-40ef-a381-eb4c3fac2fc5 req-e94408cc-1d31-4de8-a74d-ba00f9054bf2 service nova] Creating event network-changed:f83c1559-bd4d-464d-a64e-211ac4f14239 for instance 0656c7c5-439a-47a8-ab73-8a5e4e007bbd on hv-cinder-78605 Apr 19 03:43:31.445816 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-48861ee6-91d9-40ef-a381-eb4c3fac2fc5 req-e94408cc-1d31-4de8-a74d-ba00f9054bf2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120603 Apr 19 03:43:31.447087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 397/749] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:43:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:43:31.544202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6281b0af-9287-41fc-8f2d-597c6639e337 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.222937 Apr 19 03:43:31.545345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 353/750] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:31 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:32.558094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e57fc71f-3924-448c-b338-41afa8f18439 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:32.559427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e57fc71f-3924-448c-b338-41afa8f18439 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:32.581085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e57fc71f-3924-448c-b338-41afa8f18439 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:32.585169 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e57fc71f-3924-448c-b338-41afa8f18439 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:32.587006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e57fc71f-3924-448c-b338-41afa8f18439 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:32.592576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e57fc71f-3924-448c-b338-41afa8f18439 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:32.806905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e57fc71f-3924-448c-b338-41afa8f18439 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.253601 Apr 19 03:43:32.807972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 398/751] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:32 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:33.819158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9bb47b82-1d19-4c3b-a51c-7dc33668bf5c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:33.824021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9bb47b82-1d19-4c3b-a51c-7dc33668bf5c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:33.851731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9bb47b82-1d19-4c3b-a51c-7dc33668bf5c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:33.852929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9bb47b82-1d19-4c3b-a51c-7dc33668bf5c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:33.854090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9bb47b82-1d19-4c3b-a51c-7dc33668bf5c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:33.854839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9bb47b82-1d19-4c3b-a51c-7dc33668bf5c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:34.003667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9bb47b82-1d19-4c3b-a51c-7dc33668bf5c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.188848 Apr 19 03:43:34.005282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 354/752] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:33 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:35.016605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b79613a2-ba52-4426-b0b9-d2dc8aa94359 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:35.018786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b79613a2-ba52-4426-b0b9-d2dc8aa94359 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:35.030561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b79613a2-ba52-4426-b0b9-d2dc8aa94359 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:35.031454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b79613a2-ba52-4426-b0b9-d2dc8aa94359 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:35.032595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b79613a2-ba52-4426-b0b9-d2dc8aa94359 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:35.033288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b79613a2-ba52-4426-b0b9-d2dc8aa94359 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:35.152833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b79613a2-ba52-4426-b0b9-d2dc8aa94359 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.140360 Apr 19 03:43:35.156311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 399/753] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:35 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:36.165043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6095ec69-e847-47e5-89a4-3511910ecafa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:36.166912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6095ec69-e847-47e5-89a4-3511910ecafa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:36.177574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6095ec69-e847-47e5-89a4-3511910ecafa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:36.178312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6095ec69-e847-47e5-89a4-3511910ecafa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:36.179384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6095ec69-e847-47e5-89a4-3511910ecafa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:36.180108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6095ec69-e847-47e5-89a4-3511910ecafa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:36.322973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6095ec69-e847-47e5-89a4-3511910ecafa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.163010 Apr 19 03:43:36.337522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 355/754] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:36 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:37.233096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6e75af89-4e1d-4ff1-90e0-22222d0adb5a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "258f4f69-0f29-4870-9bdd-59538030598a", "device": "/dev/sdb"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:37.234885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6e75af89-4e1d-4ff1-90e0-22222d0adb5a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:37.244367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e75af89-4e1d-4ff1-90e0-22222d0adb5a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:37.245231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e75af89-4e1d-4ff1-90e0-22222d0adb5a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:37.246081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e75af89-4e1d-4ff1-90e0-22222d0adb5a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:37.246568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e75af89-4e1d-4ff1-90e0-22222d0adb5a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:37.336699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-01d0f4fb-5631-484a-80bd-f0ea7564a801 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:37.338065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-01d0f4fb-5631-484a-80bd-f0ea7564a801 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:37.347095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01d0f4fb-5631-484a-80bd-f0ea7564a801 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:37.347793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01d0f4fb-5631-484a-80bd-f0ea7564a801 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:37.348760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01d0f4fb-5631-484a-80bd-f0ea7564a801 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:37.349280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01d0f4fb-5631-484a-80bd-f0ea7564a801 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:37.473130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-01d0f4fb-5631-484a-80bd-f0ea7564a801 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.142323 Apr 19 03:43:37.473836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 356/755] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:37 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:37.645773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-18afcb90-ce81-42b7-bdb7-197819ffdb38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:37.646455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-18afcb90-ce81-42b7-bdb7-197819ffdb38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:37.655656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-18afcb90-ce81-42b7-bdb7-197819ffdb38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:37.656016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-18afcb90-ce81-42b7-bdb7-197819ffdb38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:37.656871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-18afcb90-ce81-42b7-bdb7-197819ffdb38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:37.657373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-18afcb90-ce81-42b7-bdb7-197819ffdb38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:37.738084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-18afcb90-ce81-42b7-bdb7-197819ffdb38 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/os-volume_attachments/3dc14a02-a0a2-4aac-a115-4bc72bc806f6" status: 200 len: 194 microversion: 2.20 time: 0.096893 Apr 19 03:43:37.743373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 357/756] 10.222.0.25 () {60 vars in 1444 bytes} [Mon Apr 19 03:43:37 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/os-volume_attachments/3dc14a02-a0a2-4aac-a115-4bc72bc806f6 => generated 194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:43:37.880326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-41d88775-bdac-4bda-9363-bf3028f6ecb0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:37.880911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-41d88775-bdac-4bda-9363-bf3028f6ecb0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:37.891068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-41d88775-bdac-4bda-9363-bf3028f6ecb0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:37.891589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-41d88775-bdac-4bda-9363-bf3028f6ecb0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:37.892446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-41d88775-bdac-4bda-9363-bf3028f6ecb0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:37.892932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-41d88775-bdac-4bda-9363-bf3028f6ecb0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:38.017275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6e75af89-4e1d-4ff1-90e0-22222d0adb5a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "POST /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.788642 Apr 19 03:43:38.017943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 400/757] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:43:37 2021] POST /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c/os-volume_attachments => generated 194 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:43:38.138208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-41d88775-bdac-4bda-9363-bf3028f6ecb0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lazy-loading 'services' on Instance uuid e29b14f0-f43c-434b-b583-cdf6b0e4b784 {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:43:38.378806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-41d88775-bdac-4bda-9363-bf3028f6ecb0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/os-volume_attachments/3dc14a02-a0a2-4aac-a115-4bc72bc806f6" status: 202 len: 0 microversion: 2.20 time: 0.508247 Apr 19 03:43:38.379466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 358/758] 10.222.0.25 () {60 vars in 1447 bytes} [Mon Apr 19 03:43:37 2021] DELETE /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784/os-volume_attachments/3dc14a02-a0a2-4aac-a115-4bc72bc806f6 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 19 03:43:38.486102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-70c1329a-d81c-4e87-9e88-a271ec64f99d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:38.487511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-70c1329a-d81c-4e87-9e88-a271ec64f99d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:38.518934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70c1329a-d81c-4e87-9e88-a271ec64f99d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:38.525685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70c1329a-d81c-4e87-9e88-a271ec64f99d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:38.526929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70c1329a-d81c-4e87-9e88-a271ec64f99d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:38.527763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70c1329a-d81c-4e87-9e88-a271ec64f99d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:38.683998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-70c1329a-d81c-4e87-9e88-a271ec64f99d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.202312 Apr 19 03:43:38.684707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 401/759] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:38 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:39.695904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6cc8cd92-23d3-4b77-b442-2ccd00749e19 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:39.697261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6cc8cd92-23d3-4b77-b442-2ccd00749e19 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:39.706712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cc8cd92-23d3-4b77-b442-2ccd00749e19 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:39.707236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cc8cd92-23d3-4b77-b442-2ccd00749e19 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:39.708094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cc8cd92-23d3-4b77-b442-2ccd00749e19 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:39.708573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cc8cd92-23d3-4b77-b442-2ccd00749e19 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:39.818230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6cc8cd92-23d3-4b77-b442-2ccd00749e19 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.126623 Apr 19 03:43:39.819224 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 359/760] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:39 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:40.830993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-37ab39b8-45bf-49ef-b313-e859406d2a1f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:40.832163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-37ab39b8-45bf-49ef-b313-e859406d2a1f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:40.840832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37ab39b8-45bf-49ef-b313-e859406d2a1f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:40.841347 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37ab39b8-45bf-49ef-b313-e859406d2a1f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:40.842175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37ab39b8-45bf-49ef-b313-e859406d2a1f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:40.842669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37ab39b8-45bf-49ef-b313-e859406d2a1f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:40.948237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-37ab39b8-45bf-49ef-b313-e859406d2a1f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.121610 Apr 19 03:43:40.950746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 402/761] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:40 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:41.854099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-28b7686d-8909-41f6-86e7-ed2f9699cc01 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Action: 'create', calling method: .version_select at 0x7f9dac476950>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-479093726"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:41.878158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-28b7686d-8909-41f6-86e7-ed2f9699cc01 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Getting quotas for project 66830e413293499db3998f9e797be69c. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:43:41.882861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-28b7686d-8909-41f6-86e7-ed2f9699cc01 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Getting quotas for user 621dedc3d797460880325a84ad8c7d4f and project 66830e413293499db3998f9e797be69c. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:43:41.960869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-92df2811-a85e-45cc-aadb-4c79a2e756a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:41.962120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-92df2811-a85e-45cc-aadb-4c79a2e756a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:41.970889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92df2811-a85e-45cc-aadb-4c79a2e756a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:41.971373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92df2811-a85e-45cc-aadb-4c79a2e756a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:41.972208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92df2811-a85e-45cc-aadb-4c79a2e756a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:41.972709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92df2811-a85e-45cc-aadb-4c79a2e756a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:42.091949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-92df2811-a85e-45cc-aadb-4c79a2e756a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.135508 Apr 19 03:43:42.092625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 403/762] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:41 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:42.309001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-28b7686d-8909-41f6-86e7-ed2f9699cc01 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Getting quotas for project 66830e413293499db3998f9e797be69c. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:43:42.312906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-28b7686d-8909-41f6-86e7-ed2f9699cc01 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Getting quotas for user 621dedc3d797460880325a84ad8c7d4f and project 66830e413293499db3998f9e797be69c. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:43:42.326314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-28b7686d-8909-41f6-86e7-ed2f9699cc01 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.476849 Apr 19 03:43:42.326958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 360/763] 10.222.0.25 () {60 vars in 1148 bytes} [Mon Apr 19 03:43:41 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:42.383883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1191984246", "imageRef": "0e5c1f62-c1bc-4d31-a897-0116dd2f2751", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-479093726", "networks": [{"uuid": "fc8eb1d0-e4c3-4655-b89b-30452bcfda62"}]}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:42.454057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] validate_networks() for [('fc8eb1d0-e4c3-4655-b89b-30452bcfda62', None, None, None)] {{(pid=100591) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:43:43.063639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Flavor limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:43:43.064147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Image limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:43:43.064684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Flavor pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:43:43.065150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Image pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:43:43.065614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:43:43.074575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:43.075079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:43.075987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:43.076487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:43.094690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Getting quotas for project 66830e413293499db3998f9e797be69c. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:43:43.099039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Getting quotas for user 621dedc3d797460880325a84ad8c7d4f and project 66830e413293499db3998f9e797be69c. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:43:43.104725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fc980cbd-a064-4a00-8824-05ef4e8165e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:43.105887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fc980cbd-a064-4a00-8824-05ef4e8165e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:43.111710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Going to run 1 instances... {{(pid=100591) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:43:43.114612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0e5c1f62-c1bc-4d31-a897-0116dd2f2751',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:43:43.115516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc980cbd-a064-4a00-8824-05ef4e8165e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:43.116029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc980cbd-a064-4a00-8824-05ef4e8165e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:43.116869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc980cbd-a064-4a00-8824-05ef4e8165e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:43.117364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc980cbd-a064-4a00-8824-05ef4e8165e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:43.221977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fc980cbd-a064-4a00-8824-05ef4e8165e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.122226 Apr 19 03:43:43.223405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 361/764] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:43 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 19 03:43:43.580237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-711ec214-6ccc-4a57-9ca7-a76e9728b24c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201387 Apr 19 03:43:43.581098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 404/765] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:43:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 03:43:43.593045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-454a4689-2a17-4418-ad87-d0263388801a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:43.593824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-454a4689-2a17-4418-ad87-d0263388801a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:43.734759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-454a4689-2a17-4418-ad87-d0263388801a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:43.743365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-454a4689-2a17-4418-ad87-d0263388801a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1258 microversion: 2.1 time: 0.155296 Apr 19 03:43:43.744054 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 362/766] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:43 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:44.234418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3153fb28-f373-4784-861d-3cb935850085 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:44.235601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3153fb28-f373-4784-861d-3cb935850085 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:44.245306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3153fb28-f373-4784-861d-3cb935850085 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:44.245813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3153fb28-f373-4784-861d-3cb935850085 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:44.246640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3153fb28-f373-4784-861d-3cb935850085 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:44.247128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3153fb28-f373-4784-861d-3cb935850085 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:44.367713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3153fb28-f373-4784-861d-3cb935850085 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 14 microversion: 2.1 time: 0.137412 Apr 19 03:43:44.368431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 405/767] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:44 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 03:43:44.762179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ff4678f7-2ce6-4e90-88df-64b617100a5f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:44.762951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ff4678f7-2ce6-4e90-88df-64b617100a5f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:44.772159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff4678f7-2ce6-4e90-88df-64b617100a5f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:44.772671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff4678f7-2ce6-4e90-88df-64b617100a5f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:44.773504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff4678f7-2ce6-4e90-88df-64b617100a5f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:44.774018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff4678f7-2ce6-4e90-88df-64b617100a5f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:44.896736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ff4678f7-2ce6-4e90-88df-64b617100a5f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:44.905370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ff4678f7-2ce6-4e90-88df-64b617100a5f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1310 microversion: 2.1 time: 0.147952 Apr 19 03:43:44.905985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 363/768] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:44 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1310 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:45.380212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-91260edb-b0bc-488a-a01d-2065ea54892f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:45.381939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-91260edb-b0bc-488a-a01d-2065ea54892f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:45.390661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91260edb-b0bc-488a-a01d-2065ea54892f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:45.391198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91260edb-b0bc-488a-a01d-2065ea54892f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:45.392056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91260edb-b0bc-488a-a01d-2065ea54892f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:45.392555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91260edb-b0bc-488a-a01d-2065ea54892f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:45.519863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-91260edb-b0bc-488a-a01d-2065ea54892f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 4056 microversion: 2.1 time: 0.143976 Apr 19 03:43:45.524037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 406/769] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:45 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 4056 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:45.924242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fe292692-bcb4-4d93-af8d-a71a26a66093 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:45.924923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fe292692-bcb4-4d93-af8d-a71a26a66093 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:45.934582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe292692-bcb4-4d93-af8d-a71a26a66093 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:45.946189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe292692-bcb4-4d93-af8d-a71a26a66093 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:45.947425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe292692-bcb4-4d93-af8d-a71a26a66093 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:45.948097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe292692-bcb4-4d93-af8d-a71a26a66093 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:46.138874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fe292692-bcb4-4d93-af8d-a71a26a66093 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:46.148977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fe292692-bcb4-4d93-af8d-a71a26a66093 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1316 microversion: 2.1 time: 0.228611 Apr 19 03:43:46.149915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 364/770] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:45 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:46.533665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e29dd9eb-3e6d-4846-88f6-c581a4ef0ac3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:43:46.535407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e29dd9eb-3e6d-4846-88f6-c581a4ef0ac3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:46.569423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e29dd9eb-3e6d-4846-88f6-c581a4ef0ac3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:46.577822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e29dd9eb-3e6d-4846-88f6-c581a4ef0ac3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:46.579021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e29dd9eb-3e6d-4846-88f6-c581a4ef0ac3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:46.579753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e29dd9eb-3e6d-4846-88f6-c581a4ef0ac3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:46.887560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a5509b2d-00e7-40c8-bca5-10ca033751bf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:46.888271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a5509b2d-00e7-40c8-bca5-10ca033751bf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:46.897546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5509b2d-00e7-40c8-bca5-10ca033751bf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:46.898135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5509b2d-00e7-40c8-bca5-10ca033751bf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:46.899200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5509b2d-00e7-40c8-bca5-10ca033751bf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:46.899729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5509b2d-00e7-40c8-bca5-10ca033751bf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:46.969753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a5509b2d-00e7-40c8-bca5-10ca033751bf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:43:47.171365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a5509b2d-00e7-40c8-bca5-10ca033751bf tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 204 len: 0 microversion: 2.20 time: 0.287537 Apr 19 03:43:47.172081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 365/771] 10.222.0.25 () {60 vars in 1270 bytes} [Mon Apr 19 03:43:46 2021] DELETE /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 03:43:47.178103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c164fdee-8eb5-4bff-a96e-17a653a603c6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:47.179085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c164fdee-8eb5-4bff-a96e-17a653a603c6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:47.186927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c164fdee-8eb5-4bff-a96e-17a653a603c6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:47.187478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c164fdee-8eb5-4bff-a96e-17a653a603c6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:47.188314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c164fdee-8eb5-4bff-a96e-17a653a603c6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:47.188796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c164fdee-8eb5-4bff-a96e-17a653a603c6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:47.405193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c164fdee-8eb5-4bff-a96e-17a653a603c6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:47.415802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c164fdee-8eb5-4bff-a96e-17a653a603c6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.242276 Apr 19 03:43:47.416447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 366/772] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:47 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:43:47.421575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-911352de-b38c-4159-b8ce-4e564e20611a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:47.422122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-911352de-b38c-4159-b8ce-4e564e20611a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:47.429985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-911352de-b38c-4159-b8ce-4e564e20611a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:47.430494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-911352de-b38c-4159-b8ce-4e564e20611a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:47.431375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-911352de-b38c-4159-b8ce-4e564e20611a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:47.431870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-911352de-b38c-4159-b8ce-4e564e20611a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:47.665409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-911352de-b38c-4159-b8ce-4e564e20611a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:47.675543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-911352de-b38c-4159-b8ce-4e564e20611a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:47.677175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-911352de-b38c-4159-b8ce-4e564e20611a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:47.678389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-911352de-b38c-4159-b8ce-4e564e20611a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.260951 Apr 19 03:43:47.678999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 367/773] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:43:47 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:43:48.434447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e77c3c76-24a7-4005-b690-1ffad64bc4fb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:48.435330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e77c3c76-24a7-4005-b690-1ffad64bc4fb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:48.443447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e77c3c76-24a7-4005-b690-1ffad64bc4fb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:48.443956 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e77c3c76-24a7-4005-b690-1ffad64bc4fb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:48.444822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e77c3c76-24a7-4005-b690-1ffad64bc4fb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:48.445310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e77c3c76-24a7-4005-b690-1ffad64bc4fb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:48.704620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e77c3c76-24a7-4005-b690-1ffad64bc4fb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:48.714713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e77c3c76-24a7-4005-b690-1ffad64bc4fb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.284314 Apr 19 03:43:48.725461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 368/774] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:48 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:43:48.730791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e9f0c017-0f60-4388-b17a-400f02ad8b99 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:48.731498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e9f0c017-0f60-4388-b17a-400f02ad8b99 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:48.739672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9f0c017-0f60-4388-b17a-400f02ad8b99 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:48.740185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9f0c017-0f60-4388-b17a-400f02ad8b99 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:48.741021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9f0c017-0f60-4388-b17a-400f02ad8b99 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:48.741600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9f0c017-0f60-4388-b17a-400f02ad8b99 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:48.972199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e9f0c017-0f60-4388-b17a-400f02ad8b99 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:48.982926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e9f0c017-0f60-4388-b17a-400f02ad8b99 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:48.984632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e9f0c017-0f60-4388-b17a-400f02ad8b99 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:48.985955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e9f0c017-0f60-4388-b17a-400f02ad8b99 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.259331 Apr 19 03:43:48.986575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 369/775] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:43:48 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:43:49.733443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7cc741bd-60a1-4e93-aaa0-0fa6bb136316 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:49.734082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7cc741bd-60a1-4e93-aaa0-0fa6bb136316 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:49.744234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cc741bd-60a1-4e93-aaa0-0fa6bb136316 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:49.745093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cc741bd-60a1-4e93-aaa0-0fa6bb136316 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:49.746080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cc741bd-60a1-4e93-aaa0-0fa6bb136316 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:49.746558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cc741bd-60a1-4e93-aaa0-0fa6bb136316 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:49.970963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7cc741bd-60a1-4e93-aaa0-0fa6bb136316 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:49.980690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7cc741bd-60a1-4e93-aaa0-0fa6bb136316 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.251214 Apr 19 03:43:49.981339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 370/776] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:49 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:43:50.006587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1d9e10be-3fd7-4c51-b686-2c5055db25aa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:50.007293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1d9e10be-3fd7-4c51-b686-2c5055db25aa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:50.015403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d9e10be-3fd7-4c51-b686-2c5055db25aa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:50.015904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d9e10be-3fd7-4c51-b686-2c5055db25aa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:50.016728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d9e10be-3fd7-4c51-b686-2c5055db25aa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:50.017214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d9e10be-3fd7-4c51-b686-2c5055db25aa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:50.234376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1d9e10be-3fd7-4c51-b686-2c5055db25aa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:50.244909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1d9e10be-3fd7-4c51-b686-2c5055db25aa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:50.246591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1d9e10be-3fd7-4c51-b686-2c5055db25aa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:50.247849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1d9e10be-3fd7-4c51-b686-2c5055db25aa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.245565 Apr 19 03:43:50.248475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 371/777] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:43:50 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:43:50.999491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e89dbfcf-3f69-48a3-b7d0-bf9d25e48ca1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:51.000167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e89dbfcf-3f69-48a3-b7d0-bf9d25e48ca1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:51.009144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e89dbfcf-3f69-48a3-b7d0-bf9d25e48ca1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:51.009649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e89dbfcf-3f69-48a3-b7d0-bf9d25e48ca1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:51.010472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e89dbfcf-3f69-48a3-b7d0-bf9d25e48ca1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:51.010959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e89dbfcf-3f69-48a3-b7d0-bf9d25e48ca1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:51.236437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e89dbfcf-3f69-48a3-b7d0-bf9d25e48ca1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:51.246581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e89dbfcf-3f69-48a3-b7d0-bf9d25e48ca1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.251122 Apr 19 03:43:51.247206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 372/778] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:50 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:43:51.267951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2d18eba1-cce1-4896-8f64-9faa45bde3d0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:51.272370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2d18eba1-cce1-4896-8f64-9faa45bde3d0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:51.277557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d18eba1-cce1-4896-8f64-9faa45bde3d0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:51.278069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d18eba1-cce1-4896-8f64-9faa45bde3d0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:51.278912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d18eba1-cce1-4896-8f64-9faa45bde3d0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:51.279435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d18eba1-cce1-4896-8f64-9faa45bde3d0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:51.506237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2d18eba1-cce1-4896-8f64-9faa45bde3d0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:51.517483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2d18eba1-cce1-4896-8f64-9faa45bde3d0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:51.519135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2d18eba1-cce1-4896-8f64-9faa45bde3d0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:51.520374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2d18eba1-cce1-4896-8f64-9faa45bde3d0 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.256804 Apr 19 03:43:51.520982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 373/779] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:43:51 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:43:52.265052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e339731a-e8f2-4e16-8987-1211db925747 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:52.265717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e339731a-e8f2-4e16-8987-1211db925747 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:52.274192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e339731a-e8f2-4e16-8987-1211db925747 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:52.274686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e339731a-e8f2-4e16-8987-1211db925747 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:52.275538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e339731a-e8f2-4e16-8987-1211db925747 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:52.276020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e339731a-e8f2-4e16-8987-1211db925747 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:52.506814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e339731a-e8f2-4e16-8987-1211db925747 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:52.515617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e339731a-e8f2-4e16-8987-1211db925747 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.254606 Apr 19 03:43:52.516233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 374/780] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:52 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:43:52.539958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-71ec1f59-5205-4d21-ab1f-b6e84997e26e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:52.540617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-71ec1f59-5205-4d21-ab1f-b6e84997e26e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:52.548246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71ec1f59-5205-4d21-ab1f-b6e84997e26e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:52.548754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71ec1f59-5205-4d21-ab1f-b6e84997e26e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:52.549600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71ec1f59-5205-4d21-ab1f-b6e84997e26e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:52.550088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71ec1f59-5205-4d21-ab1f-b6e84997e26e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:52.771324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-71ec1f59-5205-4d21-ab1f-b6e84997e26e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:52.781343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-71ec1f59-5205-4d21-ab1f-b6e84997e26e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:52.783005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-71ec1f59-5205-4d21-ab1f-b6e84997e26e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:52.784250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-71ec1f59-5205-4d21-ab1f-b6e84997e26e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.248117 Apr 19 03:43:52.784879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 375/781] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:43:52 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:43:53.533796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0e343227-d1a8-4bea-8250-3ccf34e24170 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:53.535381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0e343227-d1a8-4bea-8250-3ccf34e24170 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:53.543779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e343227-d1a8-4bea-8250-3ccf34e24170 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:53.547454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e343227-d1a8-4bea-8250-3ccf34e24170 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:53.547454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e343227-d1a8-4bea-8250-3ccf34e24170 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:53.547454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e343227-d1a8-4bea-8250-3ccf34e24170 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:53.788042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0e343227-d1a8-4bea-8250-3ccf34e24170 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:53.816426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0e343227-d1a8-4bea-8250-3ccf34e24170 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.286232 Apr 19 03:43:53.817584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 376/782] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:53 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:43:53.827226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-33a79c17-769e-467d-9113-a8cf46d09798 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:53.828516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-33a79c17-769e-467d-9113-a8cf46d09798 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:53.841486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33a79c17-769e-467d-9113-a8cf46d09798 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:53.841969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33a79c17-769e-467d-9113-a8cf46d09798 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:53.842818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33a79c17-769e-467d-9113-a8cf46d09798 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:53.843362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33a79c17-769e-467d-9113-a8cf46d09798 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:54.068944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-33a79c17-769e-467d-9113-a8cf46d09798 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:54.079737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-33a79c17-769e-467d-9113-a8cf46d09798 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:54.081424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-33a79c17-769e-467d-9113-a8cf46d09798 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:54.083120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-33a79c17-769e-467d-9113-a8cf46d09798 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.264030 Apr 19 03:43:54.083966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 377/783] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:43:53 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:43:54.846059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-46d749ca-5043-4dfa-925d-a13140a2b0c9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:54.846728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-46d749ca-5043-4dfa-925d-a13140a2b0c9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:54.854851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-46d749ca-5043-4dfa-925d-a13140a2b0c9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:54.855341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-46d749ca-5043-4dfa-925d-a13140a2b0c9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:54.856168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-46d749ca-5043-4dfa-925d-a13140a2b0c9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:54.856659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-46d749ca-5043-4dfa-925d-a13140a2b0c9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:55.069145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-46d749ca-5043-4dfa-925d-a13140a2b0c9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:55.078059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-46d749ca-5043-4dfa-925d-a13140a2b0c9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.236320 Apr 19 03:43:55.078680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 378/784] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:54 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:43:55.103827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7873c6b7-dafc-4a81-8910-1615b50fe160 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:55.104501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7873c6b7-dafc-4a81-8910-1615b50fe160 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:55.112876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7873c6b7-dafc-4a81-8910-1615b50fe160 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:55.113323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7873c6b7-dafc-4a81-8910-1615b50fe160 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:55.114165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7873c6b7-dafc-4a81-8910-1615b50fe160 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:55.114650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7873c6b7-dafc-4a81-8910-1615b50fe160 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:55.338285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7873c6b7-dafc-4a81-8910-1615b50fe160 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:55.349671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7873c6b7-dafc-4a81-8910-1615b50fe160 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:55.357463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7873c6b7-dafc-4a81-8910-1615b50fe160 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:55.357463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7873c6b7-dafc-4a81-8910-1615b50fe160 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.254266 Apr 19 03:43:55.357463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 379/785] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:43:55 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:43:56.096739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7685557-66c8-42c7-b8a1-3c53391dd80a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:56.097402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b7685557-66c8-42c7-b8a1-3c53391dd80a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:56.105410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7685557-66c8-42c7-b8a1-3c53391dd80a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:56.105911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7685557-66c8-42c7-b8a1-3c53391dd80a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:56.106729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7685557-66c8-42c7-b8a1-3c53391dd80a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:56.107258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7685557-66c8-42c7-b8a1-3c53391dd80a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:56.389057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b7685557-66c8-42c7-b8a1-3c53391dd80a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:56.389057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b7685557-66c8-42c7-b8a1-3c53391dd80a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.264638 Apr 19 03:43:56.389057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 380/786] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:56 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:43:56.389057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-861149be-c2c0-4940-89d8-1789e4dfce7f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:56.389640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-861149be-c2c0-4940-89d8-1789e4dfce7f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:56.389640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-861149be-c2c0-4940-89d8-1789e4dfce7f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:56.389640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-861149be-c2c0-4940-89d8-1789e4dfce7f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:56.389640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-861149be-c2c0-4940-89d8-1789e4dfce7f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:56.389938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-861149be-c2c0-4940-89d8-1789e4dfce7f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:56.631303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-861149be-c2c0-4940-89d8-1789e4dfce7f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:56.642105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-861149be-c2c0-4940-89d8-1789e4dfce7f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:56.643742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-861149be-c2c0-4940-89d8-1789e4dfce7f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:56.644965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-861149be-c2c0-4940-89d8-1789e4dfce7f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.273424 Apr 19 03:43:56.645581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 381/787] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:43:56 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:43:57.376607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-73c3a069-d47a-4a47-94cb-7e12b868c1b8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:57.377276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-73c3a069-d47a-4a47-94cb-7e12b868c1b8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:57.385632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-73c3a069-d47a-4a47-94cb-7e12b868c1b8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:57.386138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-73c3a069-d47a-4a47-94cb-7e12b868c1b8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:57.386963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-73c3a069-d47a-4a47-94cb-7e12b868c1b8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:57.387501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-73c3a069-d47a-4a47-94cb-7e12b868c1b8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:57.603358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-73c3a069-d47a-4a47-94cb-7e12b868c1b8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:57.612872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-73c3a069-d47a-4a47-94cb-7e12b868c1b8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.240226 Apr 19 03:43:57.613565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 382/788] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:57 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:43:57.664554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-167b889e-a8fd-49f4-9237-785ec078342f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:57.665156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-167b889e-a8fd-49f4-9237-785ec078342f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:57.673458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-167b889e-a8fd-49f4-9237-785ec078342f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:57.673968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-167b889e-a8fd-49f4-9237-785ec078342f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:57.674798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-167b889e-a8fd-49f4-9237-785ec078342f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:57.675312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-167b889e-a8fd-49f4-9237-785ec078342f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:57.896087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-167b889e-a8fd-49f4-9237-785ec078342f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:57.907368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-167b889e-a8fd-49f4-9237-785ec078342f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:57.909419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-167b889e-a8fd-49f4-9237-785ec078342f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:57.910640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-167b889e-a8fd-49f4-9237-785ec078342f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.250079 Apr 19 03:43:57.911269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 383/789] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:43:57 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:43:58.630660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-970f6b66-da79-45ef-8cbc-c60df10e6b40 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:58.631359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-970f6b66-da79-45ef-8cbc-c60df10e6b40 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:58.639240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-970f6b66-da79-45ef-8cbc-c60df10e6b40 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:58.639744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-970f6b66-da79-45ef-8cbc-c60df10e6b40 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:58.640562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-970f6b66-da79-45ef-8cbc-c60df10e6b40 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:58.641046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-970f6b66-da79-45ef-8cbc-c60df10e6b40 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:59.075124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-970f6b66-da79-45ef-8cbc-c60df10e6b40 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:59.083918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-970f6b66-da79-45ef-8cbc-c60df10e6b40 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.457443 Apr 19 03:43:59.085188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 384/790] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:43:58 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:43:59.089842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0dad2fbd-d11d-43bc-b772-2c1103121e8d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:43:59.090512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0dad2fbd-d11d-43bc-b772-2c1103121e8d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:43:59.097848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0dad2fbd-d11d-43bc-b772-2c1103121e8d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:59.098351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0dad2fbd-d11d-43bc-b772-2c1103121e8d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:59.099193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0dad2fbd-d11d-43bc-b772-2c1103121e8d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:43:59.099687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0dad2fbd-d11d-43bc-b772-2c1103121e8d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:43:59.307548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0dad2fbd-d11d-43bc-b772-2c1103121e8d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:59.317454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0dad2fbd-d11d-43bc-b772-2c1103121e8d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:59.319753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0dad2fbd-d11d-43bc-b772-2c1103121e8d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:43:59.320971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0dad2fbd-d11d-43bc-b772-2c1103121e8d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.234797 Apr 19 03:43:59.321588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 385/791] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:43:59 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:00.102842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-570b581c-7888-4cad-a520-5590c523e6f5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:00.103539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-570b581c-7888-4cad-a520-5590c523e6f5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:00.111976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-570b581c-7888-4cad-a520-5590c523e6f5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:00.112761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-570b581c-7888-4cad-a520-5590c523e6f5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:00.113619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-570b581c-7888-4cad-a520-5590c523e6f5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:00.114451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-570b581c-7888-4cad-a520-5590c523e6f5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:00.330699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-570b581c-7888-4cad-a520-5590c523e6f5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:00.341782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-570b581c-7888-4cad-a520-5590c523e6f5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.243628 Apr 19 03:44:00.348820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 386/792] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:00 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:00.356058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ba3b1c26-a1d6-49a5-9738-abf6079d1a5e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:00.356733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ba3b1c26-a1d6-49a5-9738-abf6079d1a5e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:00.365079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba3b1c26-a1d6-49a5-9738-abf6079d1a5e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:00.365589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba3b1c26-a1d6-49a5-9738-abf6079d1a5e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:00.366425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba3b1c26-a1d6-49a5-9738-abf6079d1a5e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:00.366918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba3b1c26-a1d6-49a5-9738-abf6079d1a5e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:00.598748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ba3b1c26-a1d6-49a5-9738-abf6079d1a5e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:00.610648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ba3b1c26-a1d6-49a5-9738-abf6079d1a5e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:00.613095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ba3b1c26-a1d6-49a5-9738-abf6079d1a5e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:00.614952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ba3b1c26-a1d6-49a5-9738-abf6079d1a5e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1801 microversion: 2.20 time: 0.264781 Apr 19 03:44:00.616231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 387/793] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:00 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1801 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:01.359597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-583b1705-1475-425c-b3e8-455d7a0a4bb4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:01.367416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-583b1705-1475-425c-b3e8-455d7a0a4bb4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:01.368350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-583b1705-1475-425c-b3e8-455d7a0a4bb4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:01.368851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-583b1705-1475-425c-b3e8-455d7a0a4bb4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:01.369714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-583b1705-1475-425c-b3e8-455d7a0a4bb4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:01.370198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-583b1705-1475-425c-b3e8-455d7a0a4bb4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:01.580730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-583b1705-1475-425c-b3e8-455d7a0a4bb4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:01.590477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-583b1705-1475-425c-b3e8-455d7a0a4bb4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.234911 Apr 19 03:44:01.591232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 388/794] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:01 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:01.595883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e29dd9eb-3e6d-4846-88f6-c581a4ef0ac3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 28072 microversion: 2.1 time: 15.066766 Apr 19 03:44:01.597245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 407/795] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:43:46 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 28072 bytes in 15070 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:01.635907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-33a7bae7-676f-4765-9dff-dca15b7de617 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:01.636576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-33a7bae7-676f-4765-9dff-dca15b7de617 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:01.644613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33a7bae7-676f-4765-9dff-dca15b7de617 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:01.648496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33a7bae7-676f-4765-9dff-dca15b7de617 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:01.648496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33a7bae7-676f-4765-9dff-dca15b7de617 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:01.648496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33a7bae7-676f-4765-9dff-dca15b7de617 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:01.863931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-33a7bae7-676f-4765-9dff-dca15b7de617 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:01.873465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-33a7bae7-676f-4765-9dff-dca15b7de617 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:01.875168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-33a7bae7-676f-4765-9dff-dca15b7de617 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:01.876380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-33a7bae7-676f-4765-9dff-dca15b7de617 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1723 microversion: 2.20 time: 0.244784 Apr 19 03:44:01.876992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 389/796] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:01 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:02.612892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5ee2a165-e4d0-4094-95ac-79e2d5376b69 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:02.612892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5ee2a165-e4d0-4094-95ac-79e2d5376b69 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:02.641319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ee2a165-e4d0-4094-95ac-79e2d5376b69 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:02.641861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ee2a165-e4d0-4094-95ac-79e2d5376b69 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:02.644119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ee2a165-e4d0-4094-95ac-79e2d5376b69 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:02.644885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ee2a165-e4d0-4094-95ac-79e2d5376b69 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:02.684147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-3481a70b-85b8-48b0-b808-bf89a9afcab6 req-466888fb-bb0b-4bd6-aafc-680f33f3215c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eebf65c-de9c-4548-aab3-63d7c52a229c", "tag": "589d1f32-cd4b-4443-9982-41cdb9265434"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:02.687417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:02.687417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:02.698026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-3481a70b-85b8-48b0-b808-bf89a9afcab6 req-466888fb-bb0b-4bd6-aafc-680f33f3215c service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:02.698851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-3481a70b-85b8-48b0-b808-bf89a9afcab6 req-466888fb-bb0b-4bd6-aafc-680f33f3215c service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:02.719258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-3481a70b-85b8-48b0-b808-bf89a9afcab6 req-466888fb-bb0b-4bd6-aafc-680f33f3215c service nova] Creating event network-changed:589d1f32-cd4b-4443-9982-41cdb9265434 for instance 0eebf65c-de9c-4548-aab3-63d7c52a229c on hv-cinder-78605 Apr 19 03:44:02.724673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-3481a70b-85b8-48b0-b808-bf89a9afcab6 req-466888fb-bb0b-4bd6-aafc-680f33f3215c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149670 Apr 19 03:44:02.725978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 408/797] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:02.731722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c1c5d719-e569-4251-a19d-37ed87b564c1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:02.732502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c1c5d719-e569-4251-a19d-37ed87b564c1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:02.741863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1c5d719-e569-4251-a19d-37ed87b564c1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:02.742359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1c5d719-e569-4251-a19d-37ed87b564c1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:02.743487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1c5d719-e569-4251-a19d-37ed87b564c1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:02.744345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1c5d719-e569-4251-a19d-37ed87b564c1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:02.759820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5ee2a165-e4d0-4094-95ac-79e2d5376b69 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 28189 microversion: 2.1 time: 0.154186 Apr 19 03:44:02.760878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 390/798] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:02 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 28189 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:02.896855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-428c43ea-6ba8-4381-a840-7147903f99e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:02.898091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-428c43ea-6ba8-4381-a840-7147903f99e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:02.906972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-428c43ea-6ba8-4381-a840-7147903f99e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:02.907573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-428c43ea-6ba8-4381-a840-7147903f99e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:02.908474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-428c43ea-6ba8-4381-a840-7147903f99e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:02.908957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-428c43ea-6ba8-4381-a840-7147903f99e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:03.127895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-428c43ea-6ba8-4381-a840-7147903f99e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:03.137378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-428c43ea-6ba8-4381-a840-7147903f99e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:03.139085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-428c43ea-6ba8-4381-a840-7147903f99e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:03.140388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-428c43ea-6ba8-4381-a840-7147903f99e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1723 microversion: 2.20 time: 0.248538 Apr 19 03:44:03.141001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 391/799] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:02 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:44:03.335795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c1c5d719-e569-4251-a19d-37ed87b564c1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:03.344544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c1c5d719-e569-4251-a19d-37ed87b564c1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.617216 Apr 19 03:44:03.345530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 409/800] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:02 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:03.710791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-76b067e5-16e7-44ed-a9c2-e3eee7682390 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:03.711411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-76b067e5-16e7-44ed-a9c2-e3eee7682390 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:03.719506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76b067e5-16e7-44ed-a9c2-e3eee7682390 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:03.720079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76b067e5-16e7-44ed-a9c2-e3eee7682390 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:03.720912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76b067e5-16e7-44ed-a9c2-e3eee7682390 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:03.721397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76b067e5-16e7-44ed-a9c2-e3eee7682390 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:03.773677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9131721c-d410-4fc0-a7ce-6af4c6b44b11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:03.774801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9131721c-d410-4fc0-a7ce-6af4c6b44b11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:03.783307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9131721c-d410-4fc0-a7ce-6af4c6b44b11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:03.783902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9131721c-d410-4fc0-a7ce-6af4c6b44b11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:03.784822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9131721c-d410-4fc0-a7ce-6af4c6b44b11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:03.785386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9131721c-d410-4fc0-a7ce-6af4c6b44b11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:03.895756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9131721c-d410-4fc0-a7ce-6af4c6b44b11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 28189 microversion: 2.1 time: 0.126864 Apr 19 03:44:03.896452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 410/801] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:03 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 28189 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 19 03:44:03.909248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-76b067e5-16e7-44ed-a9c2-e3eee7682390 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lazy-loading 'services' on Instance uuid c6f609b2-0123-4d89-bdad-5cc7cf50f86c {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:44:04.147562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-76b067e5-16e7-44ed-a9c2-e3eee7682390 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c/os-volume_attachments/258f4f69-0f29-4870-9bdd-59538030598a" status: 202 len: 0 microversion: 2.1 time: 0.440655 Apr 19 03:44:04.148142 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 392/802] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:44:03 2021] DELETE /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c/os-volume_attachments/258f4f69-0f29-4870-9bdd-59538030598a => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:04.161505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0a47e82b-5087-4088-bead-8a29b1f95cb7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:04.162181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0a47e82b-5087-4088-bead-8a29b1f95cb7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:04.190841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a47e82b-5087-4088-bead-8a29b1f95cb7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:04.191409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a47e82b-5087-4088-bead-8a29b1f95cb7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:04.192322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a47e82b-5087-4088-bead-8a29b1f95cb7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:04.193216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a47e82b-5087-4088-bead-8a29b1f95cb7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:04.363949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3a4f86a6-bbcf-4ac8-932d-fbed9abbaf7c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:04.364748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3a4f86a6-bbcf-4ac8-932d-fbed9abbaf7c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:04.373019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a4f86a6-bbcf-4ac8-932d-fbed9abbaf7c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:04.373537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a4f86a6-bbcf-4ac8-932d-fbed9abbaf7c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:04.374389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a4f86a6-bbcf-4ac8-932d-fbed9abbaf7c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:04.374889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a4f86a6-bbcf-4ac8-932d-fbed9abbaf7c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:04.587846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3a4f86a6-bbcf-4ac8-932d-fbed9abbaf7c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:04.597255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3a4f86a6-bbcf-4ac8-932d-fbed9abbaf7c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.238834 Apr 19 03:44:04.598061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 393/803] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:04 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:04.795511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0a47e82b-5087-4088-bead-8a29b1f95cb7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:04.805226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0a47e82b-5087-4088-bead-8a29b1f95cb7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:04.815659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0a47e82b-5087-4088-bead-8a29b1f95cb7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:04.815659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0a47e82b-5087-4088-bead-8a29b1f95cb7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1723 microversion: 2.20 time: 0.651468 Apr 19 03:44:04.815659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 411/804] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:04 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1723 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:04.908537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-470bb938-3aaa-499c-9c82-faab47178e16 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:04.909861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-470bb938-3aaa-499c-9c82-faab47178e16 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:04.917764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-470bb938-3aaa-499c-9c82-faab47178e16 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:04.918266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-470bb938-3aaa-499c-9c82-faab47178e16 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:04.919103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-470bb938-3aaa-499c-9c82-faab47178e16 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:04.919665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-470bb938-3aaa-499c-9c82-faab47178e16 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:05.025125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-470bb938-3aaa-499c-9c82-faab47178e16 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 28214 microversion: 2.1 time: 0.120329 Apr 19 03:44:05.029248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 394/805] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:04 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 28214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:05.393826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-81846865-5204-4d4d-81e7-a6669471605b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:05.394493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-81846865-5204-4d4d-81e7-a6669471605b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:05.403000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81846865-5204-4d4d-81e7-a6669471605b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:05.403539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81846865-5204-4d4d-81e7-a6669471605b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:05.404368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81846865-5204-4d4d-81e7-a6669471605b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:05.404858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81846865-5204-4d4d-81e7-a6669471605b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:05.469354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-81846865-5204-4d4d-81e7-a6669471605b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Going to try to terminate instance {{(pid=100591) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:44:05.617723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9737c2ac-8a01-43e4-acec-ffb259096a4e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:05.618510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9737c2ac-8a01-43e4-acec-ffb259096a4e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:05.628299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9737c2ac-8a01-43e4-acec-ffb259096a4e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:05.628817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9737c2ac-8a01-43e4-acec-ffb259096a4e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:05.629665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9737c2ac-8a01-43e4-acec-ffb259096a4e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:05.630157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9737c2ac-8a01-43e4-acec-ffb259096a4e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:05.673520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-81846865-5204-4d4d-81e7-a6669471605b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 204 len: 0 microversion: 2.1 time: 0.283437 Apr 19 03:44:05.674349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 412/806] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:44:05 2021] DELETE /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:44:05.684765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e9142709-acc3-44a7-9561-f90ca077614f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:05.685553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e9142709-acc3-44a7-9561-f90ca077614f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:05.696151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9142709-acc3-44a7-9561-f90ca077614f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:05.697034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9142709-acc3-44a7-9561-f90ca077614f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:05.698136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9142709-acc3-44a7-9561-f90ca077614f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:05.698629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9142709-acc3-44a7-9561-f90ca077614f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:06.005827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9737c2ac-8a01-43e4-acec-ffb259096a4e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:06.015072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9737c2ac-8a01-43e4-acec-ffb259096a4e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.402747 Apr 19 03:44:06.015886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 395/807] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:05 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:06.031063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-580879cb-45a3-447f-8895-a7cfa101efb5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:06.032731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-580879cb-45a3-447f-8895-a7cfa101efb5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:06.042874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-580879cb-45a3-447f-8895-a7cfa101efb5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:06.043495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-580879cb-45a3-447f-8895-a7cfa101efb5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:06.044362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-580879cb-45a3-447f-8895-a7cfa101efb5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:06.057159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-580879cb-45a3-447f-8895-a7cfa101efb5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:06.171674 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e9142709-acc3-44a7-9561-f90ca077614f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:06.181165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e9142709-acc3-44a7-9561-f90ca077614f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1515 microversion: 2.1 time: 0.501173 Apr 19 03:44:06.182007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 413/808] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:05 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1515 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:06.187304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-76f2ee92-9c45-4db4-8efb-c9d89915fbe5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:06.188992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-76f2ee92-9c45-4db4-8efb-c9d89915fbe5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:06.192071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-580879cb-45a3-447f-8895-a7cfa101efb5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:06.197588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76f2ee92-9c45-4db4-8efb-c9d89915fbe5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:06.198308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76f2ee92-9c45-4db4-8efb-c9d89915fbe5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:06.199327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76f2ee92-9c45-4db4-8efb-c9d89915fbe5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:06.199899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76f2ee92-9c45-4db4-8efb-c9d89915fbe5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:06.205403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-580879cb-45a3-447f-8895-a7cfa101efb5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:06.207178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-580879cb-45a3-447f-8895-a7cfa101efb5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:06.208442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-580879cb-45a3-447f-8895-a7cfa101efb5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 200 len: 1655 microversion: 2.20 time: 0.181516 Apr 19 03:44:06.217942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 396/809] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:06 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 1655 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:06.217942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-7e11700f-30f1-46be-82fa-670938dd988a req-331f799d-d1cc-4cf5-a4ed-8c5dd1efef38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e29b14f0-f43c-434b-b583-cdf6b0e4b784", "name": "network-vif-deleted", "tag": "8b1a69d0-ba1e-4994-b669-cc0e63d13b8b"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:06.217942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:06.217942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:06.228012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-7e11700f-30f1-46be-82fa-670938dd988a req-331f799d-d1cc-4cf5-a4ed-8c5dd1efef38 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:06.228641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-7e11700f-30f1-46be-82fa-670938dd988a req-331f799d-d1cc-4cf5-a4ed-8c5dd1efef38 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:06.248893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-7e11700f-30f1-46be-82fa-670938dd988a req-331f799d-d1cc-4cf5-a4ed-8c5dd1efef38 service nova] Creating event network-vif-deleted:8b1a69d0-ba1e-4994-b669-cc0e63d13b8b for instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 on hv-cinder-78605 Apr 19 03:44:06.254779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-7e11700f-30f1-46be-82fa-670938dd988a req-331f799d-d1cc-4cf5-a4ed-8c5dd1efef38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043726 Apr 19 03:44:06.255845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 397/810] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:06.324108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-76f2ee92-9c45-4db4-8efb-c9d89915fbe5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 28480 microversion: 2.1 time: 0.140353 Apr 19 03:44:06.324809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 414/811] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:06 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 28480 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:07.034827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a2637e10-7dcf-4590-8d9a-3d67453f11a6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:07.035772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a2637e10-7dcf-4590-8d9a-3d67453f11a6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:07.044555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2637e10-7dcf-4590-8d9a-3d67453f11a6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:07.045177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2637e10-7dcf-4590-8d9a-3d67453f11a6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:07.046025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2637e10-7dcf-4590-8d9a-3d67453f11a6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:07.046521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a2637e10-7dcf-4590-8d9a-3d67453f11a6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:07.201306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-382f0c94-469a-4718-b899-c3cceeb2819a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:07.202353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-382f0c94-469a-4718-b899-c3cceeb2819a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:07.213594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-382f0c94-469a-4718-b899-c3cceeb2819a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:07.214128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-382f0c94-469a-4718-b899-c3cceeb2819a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:07.215071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-382f0c94-469a-4718-b899-c3cceeb2819a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:07.215633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-382f0c94-469a-4718-b899-c3cceeb2819a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:07.270891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a2637e10-7dcf-4590-8d9a-3d67453f11a6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:07.280376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a2637e10-7dcf-4590-8d9a-3d67453f11a6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.250627 Apr 19 03:44:07.281091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 398/812] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:07 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:07.285969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-795365ff-a4f3-42b2-bb9e-a6ebab35a5b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:07.286700 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-795365ff-a4f3-42b2-bb9e-a6ebab35a5b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:07.300736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-795365ff-a4f3-42b2-bb9e-a6ebab35a5b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:07.301235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-795365ff-a4f3-42b2-bb9e-a6ebab35a5b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:07.302079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-795365ff-a4f3-42b2-bb9e-a6ebab35a5b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:07.302615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-795365ff-a4f3-42b2-bb9e-a6ebab35a5b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:07.357661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-795365ff-a4f3-42b2-bb9e-a6ebab35a5b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] HTTP exception thrown: Instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 could not be found. Apr 19 03:44:07.361192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-795365ff-a4f3-42b2-bb9e-a6ebab35a5b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Returning 404 to user: Instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:44:07.361192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-795365ff-a4f3-42b2-bb9e-a6ebab35a5b1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 404 len: 111 microversion: 2.20 time: 0.077152 Apr 19 03:44:07.361192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 399/813] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:07 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 03:44:07.366545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e7233748-510b-4703-9f61-713acb3ba3dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:07.368077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e7233748-510b-4703-9f61-713acb3ba3dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:07.376795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7233748-510b-4703-9f61-713acb3ba3dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:07.377413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7233748-510b-4703-9f61-713acb3ba3dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:07.378477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7233748-510b-4703-9f61-713acb3ba3dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:07.379322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7233748-510b-4703-9f61-713acb3ba3dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:07.445190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-382f0c94-469a-4718-b899-c3cceeb2819a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:07.454445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-382f0c94-469a-4718-b899-c3cceeb2819a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1515 microversion: 2.1 time: 0.258199 Apr 19 03:44:07.455058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 415/814] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:07 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1515 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:07.460549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1ea25164-1346-4569-9b3b-d39270d6ce6f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '.version_select at 0x7f9dac6c1b70>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:07.503485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e7233748-510b-4703-9f61-713acb3ba3dd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 28647 microversion: 2.1 time: 0.142000 Apr 19 03:44:07.504180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 400/815] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:07 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 28647 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:07.508951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1ea25164-1346-4569-9b3b-d39270d6ce6f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-174935788" status: 204 len: 0 microversion: 2.20 time: 0.052742 Apr 19 03:44:07.509582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 416/816] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Apr 19 03:44:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-174935788 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 03:44:08.300130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c86e68cc-8364-46cb-ab34-c7599c31bceb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:08.301653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c86e68cc-8364-46cb-ab34-c7599c31bceb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:08.313844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c86e68cc-8364-46cb-ab34-c7599c31bceb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:08.314569 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c86e68cc-8364-46cb-ab34-c7599c31bceb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:08.315749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c86e68cc-8364-46cb-ab34-c7599c31bceb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:08.316448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c86e68cc-8364-46cb-ab34-c7599c31bceb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:08.474213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dc8101a1-5971-490a-a2ea-7222984bd8c5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:08.474884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dc8101a1-5971-490a-a2ea-7222984bd8c5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:08.484206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc8101a1-5971-490a-a2ea-7222984bd8c5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:08.484713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc8101a1-5971-490a-a2ea-7222984bd8c5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:08.485554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc8101a1-5971-490a-a2ea-7222984bd8c5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:08.486041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc8101a1-5971-490a-a2ea-7222984bd8c5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:08.704064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c86e68cc-8364-46cb-ab34-c7599c31bceb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:08.715494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c86e68cc-8364-46cb-ab34-c7599c31bceb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.420636 Apr 19 03:44:08.717191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 401/817] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:08 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:08.722763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3d3848b1-a7bd-40a8-94b3-2c6d47ada9a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:08.724148 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3d3848b1-a7bd-40a8-94b3-2c6d47ada9a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:08.738385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d3848b1-a7bd-40a8-94b3-2c6d47ada9a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:08.746302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d3848b1-a7bd-40a8-94b3-2c6d47ada9a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:08.746302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d3848b1-a7bd-40a8-94b3-2c6d47ada9a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:08.746302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d3848b1-a7bd-40a8-94b3-2c6d47ada9a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:08.846828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3d3848b1-a7bd-40a8-94b3-2c6d47ada9a3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 28647 microversion: 2.1 time: 0.128029 Apr 19 03:44:08.847551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 402/818] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:08 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 28647 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:08.854146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-efbf9057-e6b9-449a-b95f-f3327fb0961b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'create', calling method: .version_select at 0x7f9dac4dd9d8>, body: {"keypair": {"name": "tempest-keypair-233344134"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:08.877819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-efbf9057-e6b9-449a-b95f-f3327fb0961b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for project a1596875092a4918b57b2ca36f54fbd0. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:44:08.882010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-efbf9057-e6b9-449a-b95f-f3327fb0961b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for user 4c276e843fab41419f611a5dd2adc9e8 and project a1596875092a4918b57b2ca36f54fbd0. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:44:08.944359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dc8101a1-5971-490a-a2ea-7222984bd8c5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:08.953581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dc8101a1-5971-490a-a2ea-7222984bd8c5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 200 len: 1515 microversion: 2.1 time: 0.484419 Apr 19 03:44:08.954187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 417/819] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:08 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 1515 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:08.963410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-2275b3ed-26b0-4ede-8190-3abfc7e3dee9 req-d6e2809a-b9ce-4130-9f98-a67b9b04ee6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f609b2-0123-4d89-bdad-5cc7cf50f86c", "name": "network-vif-deleted", "tag": "0de7e94e-e1d6-4305-98e5-e0bd85a974fb"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:08.965457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:08.965457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:08.974286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-2275b3ed-26b0-4ede-8190-3abfc7e3dee9 req-d6e2809a-b9ce-4130-9f98-a67b9b04ee6a service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:08.974786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-2275b3ed-26b0-4ede-8190-3abfc7e3dee9 req-d6e2809a-b9ce-4130-9f98-a67b9b04ee6a service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:08.992521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-2275b3ed-26b0-4ede-8190-3abfc7e3dee9 req-d6e2809a-b9ce-4130-9f98-a67b9b04ee6a service nova] Creating event network-vif-deleted:0de7e94e-e1d6-4305-98e5-e0bd85a974fb for instance c6f609b2-0123-4d89-bdad-5cc7cf50f86c on hv-cinder-78605 Apr 19 03:44:08.997706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-2275b3ed-26b0-4ede-8190-3abfc7e3dee9 req-d6e2809a-b9ce-4130-9f98-a67b9b04ee6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038625 Apr 19 03:44:08.998338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 418/820] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:09.167354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-efbf9057-e6b9-449a-b95f-f3327fb0961b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for project a1596875092a4918b57b2ca36f54fbd0. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:44:09.171390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-efbf9057-e6b9-449a-b95f-f3327fb0961b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for user 4c276e843fab41419f611a5dd2adc9e8 and project a1596875092a4918b57b2ca36f54fbd0. Resources: {'key_pairs'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:44:09.184718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-efbf9057-e6b9-449a-b95f-f3327fb0961b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.335832 Apr 19 03:44:09.185381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 403/821] 10.222.0.25 () {62 vars in 1189 bytes} [Mon Apr 19 03:44:08 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 337 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 19 03:44:09.735303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a4d4bb89-d13c-42ab-9215-d073454524f8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:09.736086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a4d4bb89-d13c-42ab-9215-d073454524f8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:09.745045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4d4bb89-d13c-42ab-9215-d073454524f8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:09.749365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4d4bb89-d13c-42ab-9215-d073454524f8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:09.749365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4d4bb89-d13c-42ab-9215-d073454524f8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:09.749365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4d4bb89-d13c-42ab-9215-d073454524f8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:09.860976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-af0becd6-a197-4a5d-bbd9-206cbcef74b6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:09.863536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-af0becd6-a197-4a5d-bbd9-206cbcef74b6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:09.875877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af0becd6-a197-4a5d-bbd9-206cbcef74b6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:09.877112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af0becd6-a197-4a5d-bbd9-206cbcef74b6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:09.878182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af0becd6-a197-4a5d-bbd9-206cbcef74b6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:09.878874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af0becd6-a197-4a5d-bbd9-206cbcef74b6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:09.970551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a4d4bb89-d13c-42ab-9215-d073454524f8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:09.979924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a4d4bb89-d13c-42ab-9215-d073454524f8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.249331 Apr 19 03:44:09.981132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 419/822] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:09 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:09.986008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4a66f941-ce04-462b-93be-33379d3d0ee2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:09.986315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-af0becd6-a197-4a5d-bbd9-206cbcef74b6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 28647 microversion: 2.1 time: 0.130052 Apr 19 03:44:09.986913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4a66f941-ce04-462b-93be-33379d3d0ee2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: c6f609b2-0123-4d89-bdad-5cc7cf50f86c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:09.987711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 404/823] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:09 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 28647 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:09.996497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a66f941-ce04-462b-93be-33379d3d0ee2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:09.997284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a66f941-ce04-462b-93be-33379d3d0ee2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:09.998053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a66f941-ce04-462b-93be-33379d3d0ee2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:09.998645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a66f941-ce04-462b-93be-33379d3d0ee2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:10.056121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-4a66f941-ce04-462b-93be-33379d3d0ee2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] HTTP exception thrown: Instance c6f609b2-0123-4d89-bdad-5cc7cf50f86c could not be found. Apr 19 03:44:10.056921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4a66f941-ce04-462b-93be-33379d3d0ee2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Returning 404 to user: Instance c6f609b2-0123-4d89-bdad-5cc7cf50f86c could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:44:10.057930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4a66f941-ce04-462b-93be-33379d3d0ee2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c" status: 404 len: 111 microversion: 2.1 time: 0.075974 Apr 19 03:44:10.058856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 420/824] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:09 2021] GET /compute/v2.1/servers/c6f609b2-0123-4d89-bdad-5cc7cf50f86c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:44:10.185791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-f1514a3e-5e34-4303-ad56-f867fd81527a req-ecdd09ed-9aee-4f44-8709-6fb1ae1dfcc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eebf65c-de9c-4548-aab3-63d7c52a229c", "name": "network-vif-plugged", "status": "completed", "tag": "589d1f32-cd4b-4443-9982-41cdb9265434"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:10.188055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:10.188055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:10.198461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-f1514a3e-5e34-4303-ad56-f867fd81527a req-ecdd09ed-9aee-4f44-8709-6fb1ae1dfcc6 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:10.199073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-f1514a3e-5e34-4303-ad56-f867fd81527a req-ecdd09ed-9aee-4f44-8709-6fb1ae1dfcc6 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:10.217422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-f1514a3e-5e34-4303-ad56-f867fd81527a req-ecdd09ed-9aee-4f44-8709-6fb1ae1dfcc6 service nova] Creating event network-vif-plugged:589d1f32-cd4b-4443-9982-41cdb9265434 for instance 0eebf65c-de9c-4548-aab3-63d7c52a229c on hv-cinder-78605 Apr 19 03:44:10.223318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-f1514a3e-5e34-4303-ad56-f867fd81527a req-ecdd09ed-9aee-4f44-8709-6fb1ae1dfcc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112303 Apr 19 03:44:10.227264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 405/825] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:10.998383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-47cf1a26-b225-4b22-8cc2-9545020250a5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:10.999050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-47cf1a26-b225-4b22-8cc2-9545020250a5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:11.009231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-96e67d14-f694-4070-9312-9fdacf3ed0c1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:11.010272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-96e67d14-f694-4070-9312-9fdacf3ed0c1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:11.018665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96e67d14-f694-4070-9312-9fdacf3ed0c1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:11.018835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47cf1a26-b225-4b22-8cc2-9545020250a5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:11.019186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47cf1a26-b225-4b22-8cc2-9545020250a5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:11.019301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96e67d14-f694-4070-9312-9fdacf3ed0c1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:11.020022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47cf1a26-b225-4b22-8cc2-9545020250a5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:11.020132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96e67d14-f694-4070-9312-9fdacf3ed0c1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:11.020514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47cf1a26-b225-4b22-8cc2-9545020250a5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:11.020655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96e67d14-f694-4070-9312-9fdacf3ed0c1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:11.230640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-47cf1a26-b225-4b22-8cc2-9545020250a5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:11.239711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-47cf1a26-b225-4b22-8cc2-9545020250a5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.245950 Apr 19 03:44:11.240366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 421/826] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:10 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:11.510906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1062226252", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9d39e32-f5f0-4d22-949b-73f3b0f4b690"}], "security_groups": [{"name": "tempest-securitygroup--1587673266"}], "key_name": "tempest-keypair-233344134", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:11.635880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] validate_networks() for [('a9d39e32-f5f0-4d22-949b-73f3b0f4b690', None, None, None)] {{(pid=100591) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:44:12.242449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Flavor limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:44:12.242933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Image limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:44:12.243559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Flavor pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:44:12.244065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Image pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:44:12.244527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:44:12.253550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:12.254057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:12.254920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:12.255464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:12.273449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for project a1596875092a4918b57b2ca36f54fbd0. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:44:12.277653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Getting quotas for user 4c276e843fab41419f611a5dd2adc9e8 and project a1596875092a4918b57b2ca36f54fbd0. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:44:12.289203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Going to run 1 instances... {{(pid=100591) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:44:12.291846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:44:12.375444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f34af598-0137-41be-bf4b-3a31efaf1cd8 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.869503 Apr 19 03:44:12.376154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 422/827] 10.222.0.25 () {62 vars in 1178 bytes} [Mon Apr 19 03:44:11 2021] POST /compute/v2.1/servers => generated 402 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 19 03:44:12.381727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-065e0736-1711-491e-9824-2d87b6c64eeb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:12.381727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-065e0736-1711-491e-9824-2d87b6c64eeb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:12.389399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-065e0736-1711-491e-9824-2d87b6c64eeb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:12.389913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-065e0736-1711-491e-9824-2d87b6c64eeb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:12.390752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-065e0736-1711-491e-9824-2d87b6c64eeb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:12.391276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-065e0736-1711-491e-9824-2d87b6c64eeb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:12.605672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-065e0736-1711-491e-9824-2d87b6c64eeb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:12.614972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-065e0736-1711-491e-9824-2d87b6c64eeb tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.237784 Apr 19 03:44:12.615661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 423/828] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:12 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:12.620526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8bb27674-6a38-4b4c-bda4-00e743d9d4c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:12.621192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8bb27674-6a38-4b4c-bda4-00e743d9d4c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:12.698170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8bb27674-6a38-4b4c-bda4-00e743d9d4c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:12.706891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8bb27674-6a38-4b4c-bda4-00e743d9d4c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:12.708603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8bb27674-6a38-4b4c-bda4-00e743d9d4c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:12.710452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8bb27674-6a38-4b4c-bda4-00e743d9d4c9 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1281 microversion: 2.20 time: 0.093597 Apr 19 03:44:12.710860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 424/829] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:12 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:13.633713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6e52f156-fbb6-4618-bdd0-4e5f7b758bcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:13.634385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6e52f156-fbb6-4618-bdd0-4e5f7b758bcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:13.645613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e52f156-fbb6-4618-bdd0-4e5f7b758bcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:13.646113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e52f156-fbb6-4618-bdd0-4e5f7b758bcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:13.647497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e52f156-fbb6-4618-bdd0-4e5f7b758bcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:13.647977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e52f156-fbb6-4618-bdd0-4e5f7b758bcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:13.751993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-96e67d14-f694-4070-9312-9fdacf3ed0c1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 33511 microversion: 2.1 time: 2.747027 Apr 19 03:44:13.752738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 406/830] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:11 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 33511 bytes in 2749 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:13.759513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-66bf4252-3756-4055-8370-97bf53a8dae2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:13.759649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-66bf4252-3756-4055-8370-97bf53a8dae2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:13.768307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66bf4252-3756-4055-8370-97bf53a8dae2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:13.768824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66bf4252-3756-4055-8370-97bf53a8dae2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:13.769708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66bf4252-3756-4055-8370-97bf53a8dae2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:13.770210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66bf4252-3756-4055-8370-97bf53a8dae2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:13.862721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6e52f156-fbb6-4618-bdd0-4e5f7b758bcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:13.873418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6e52f156-fbb6-4618-bdd0-4e5f7b758bcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1358 microversion: 2.1 time: 0.244359 Apr 19 03:44:13.874235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 425/831] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:13 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:13.916049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-66bf4252-3756-4055-8370-97bf53a8dae2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:13.925466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-66bf4252-3756-4055-8370-97bf53a8dae2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:13.927164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-66bf4252-3756-4055-8370-97bf53a8dae2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:13.928363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-66bf4252-3756-4055-8370-97bf53a8dae2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1285 microversion: 2.20 time: 0.174420 Apr 19 03:44:13.929088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 407/832] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:13 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:14.771209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e56fbef5-c1b4-414e-b21c-cb8dadb9b3e5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:14.772361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e56fbef5-c1b4-414e-b21c-cb8dadb9b3e5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:14.781706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e56fbef5-c1b4-414e-b21c-cb8dadb9b3e5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:14.782228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e56fbef5-c1b4-414e-b21c-cb8dadb9b3e5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:14.783296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e56fbef5-c1b4-414e-b21c-cb8dadb9b3e5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:14.783899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e56fbef5-c1b4-414e-b21c-cb8dadb9b3e5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:14.883053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e56fbef5-c1b4-414e-b21c-cb8dadb9b3e5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 34288 microversion: 2.1 time: 0.117024 Apr 19 03:44:14.887348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 426/833] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:14 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 34288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:14.890843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-13792425-a846-470a-a27a-44eeff6b8f99 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:14.891545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-13792425-a846-470a-a27a-44eeff6b8f99 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:14.905902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13792425-a846-470a-a27a-44eeff6b8f99 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:14.906416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13792425-a846-470a-a27a-44eeff6b8f99 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:14.907302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13792425-a846-470a-a27a-44eeff6b8f99 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:14.907764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13792425-a846-470a-a27a-44eeff6b8f99 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:14.947214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-111cfdd6-e431-4b1d-86d8-f34f242e13ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:14.948254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-111cfdd6-e431-4b1d-86d8-f34f242e13ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:14.957936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-111cfdd6-e431-4b1d-86d8-f34f242e13ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:14.958669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-111cfdd6-e431-4b1d-86d8-f34f242e13ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:14.960262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-111cfdd6-e431-4b1d-86d8-f34f242e13ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:14.960947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-111cfdd6-e431-4b1d-86d8-f34f242e13ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:15.109281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-111cfdd6-e431-4b1d-86d8-f34f242e13ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:15.120106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-111cfdd6-e431-4b1d-86d8-f34f242e13ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:15.121979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-111cfdd6-e431-4b1d-86d8-f34f242e13ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:15.123393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-111cfdd6-e431-4b1d-86d8-f34f242e13ca tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1351 microversion: 2.20 time: 0.180718 Apr 19 03:44:15.135867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 427/834] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:14 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1351 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:15.167768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-13792425-a846-470a-a27a-44eeff6b8f99 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:15.179263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-13792425-a846-470a-a27a-44eeff6b8f99 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1548 microversion: 2.1 time: 0.289889 Apr 19 03:44:15.179263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 408/835] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:14 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1548 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:15.195228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ab799ad8-1210-4aae-b582-bdd6e3349ba4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:15.195845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ab799ad8-1210-4aae-b582-bdd6e3349ba4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:15.203619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab799ad8-1210-4aae-b582-bdd6e3349ba4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:15.204135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab799ad8-1210-4aae-b582-bdd6e3349ba4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:15.204957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab799ad8-1210-4aae-b582-bdd6e3349ba4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:15.205446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab799ad8-1210-4aae-b582-bdd6e3349ba4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:15.594914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ab799ad8-1210-4aae-b582-bdd6e3349ba4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:15.603994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ab799ad8-1210-4aae-b582-bdd6e3349ba4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1548 microversion: 2.1 time: 0.413481 Apr 19 03:44:15.604615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 428/836] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:15 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1548 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:15.621409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f9902994-6571-4edb-a16c-aa3f3ae1d8a4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:15.625222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:15.625222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:15.626390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f9902994-6571-4edb-a16c-aa3f3ae1d8a4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:15.627242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f9902994-6571-4edb-a16c-aa3f3ae1d8a4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Searching by: {'deleted': False, 'project_id': '66830e413293499db3998f9e797be69c'} {{(pid=100590) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 19 03:44:15.633943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9902994-6571-4edb-a16c-aa3f3ae1d8a4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:15.634452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9902994-6571-4edb-a16c-aa3f3ae1d8a4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:15.635363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9902994-6571-4edb-a16c-aa3f3ae1d8a4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:15.635857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9902994-6571-4edb-a16c-aa3f3ae1d8a4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:15.735400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.multi_cell_list [None req-f9902994-6571-4edb-a16c-aa3f3ae1d8a4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=100590) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 19 03:44:15.834335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f9902994-6571-4edb-a16c-aa3f3ae1d8a4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.216905 Apr 19 03:44:15.834963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 409/837] 10.222.0.25 () {58 vars in 1115 bytes} [Mon Apr 19 03:44:15 2021] GET /compute/v2.1/servers => generated 343 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:15.846313 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3df67648-d8fe-47af-9da2-6ba96dd8e100 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:15.847814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3df67648-d8fe-47af-9da2-6ba96dd8e100 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:15.856581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3df67648-d8fe-47af-9da2-6ba96dd8e100 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:15.857299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3df67648-d8fe-47af-9da2-6ba96dd8e100 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:15.858332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3df67648-d8fe-47af-9da2-6ba96dd8e100 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:15.859039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3df67648-d8fe-47af-9da2-6ba96dd8e100 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:15.895497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3f283b31-00cb-46e9-bb2f-c41bb28644e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:15.897009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3f283b31-00cb-46e9-bb2f-c41bb28644e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:15.905368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f283b31-00cb-46e9-bb2f-c41bb28644e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:15.906295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f283b31-00cb-46e9-bb2f-c41bb28644e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:15.907368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f283b31-00cb-46e9-bb2f-c41bb28644e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:15.908037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3f283b31-00cb-46e9-bb2f-c41bb28644e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:16.013386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3f283b31-00cb-46e9-bb2f-c41bb28644e4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 35490 microversion: 2.1 time: 0.121705 Apr 19 03:44:16.014076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 410/838] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:15 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 35490 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:16.143044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4ed974cb-e201-4a23-839c-afff9c701365 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:16.143853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4ed974cb-e201-4a23-839c-afff9c701365 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:16.153025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ed974cb-e201-4a23-839c-afff9c701365 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:16.153210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ed974cb-e201-4a23-839c-afff9c701365 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:16.153987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ed974cb-e201-4a23-839c-afff9c701365 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:16.154478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ed974cb-e201-4a23-839c-afff9c701365 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:16.241795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3df67648-d8fe-47af-9da2-6ba96dd8e100 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:16.253228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3df67648-d8fe-47af-9da2-6ba96dd8e100 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1548 microversion: 2.1 time: 0.411072 Apr 19 03:44:16.254137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 429/839] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:15 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1548 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:16.438060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4ed974cb-e201-4a23-839c-afff9c701365 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:16.453042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4ed974cb-e201-4a23-839c-afff9c701365 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:16.454987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4ed974cb-e201-4a23-839c-afff9c701365 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:16.456513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4ed974cb-e201-4a23-839c-afff9c701365 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1407 microversion: 2.20 time: 0.318151 Apr 19 03:44:16.457338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 411/840] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:16 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:44:17.026596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7243e4a5-ec40-46e0-9f7e-00ff25e1c797 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:17.027750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7243e4a5-ec40-46e0-9f7e-00ff25e1c797 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:17.035737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7243e4a5-ec40-46e0-9f7e-00ff25e1c797 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:17.036199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7243e4a5-ec40-46e0-9f7e-00ff25e1c797 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:17.037053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7243e4a5-ec40-46e0-9f7e-00ff25e1c797 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:17.037557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7243e4a5-ec40-46e0-9f7e-00ff25e1c797 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:17.124651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-fe9e36b6-89ba-4dbe-a655-6805fcb166ff req-ef2a7990-ea78-481a-9cbf-4f522cff3939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b970f17-73a6-4e13-845d-a2ead7223a67", "tag": "73d56411-e2cc-4061-8eeb-efbbcd8b0986"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:17.126339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:17.126339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:17.135986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-fe9e36b6-89ba-4dbe-a655-6805fcb166ff req-ef2a7990-ea78-481a-9cbf-4f522cff3939 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:17.136487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-fe9e36b6-89ba-4dbe-a655-6805fcb166ff req-ef2a7990-ea78-481a-9cbf-4f522cff3939 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:17.154804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-fe9e36b6-89ba-4dbe-a655-6805fcb166ff req-ef2a7990-ea78-481a-9cbf-4f522cff3939 service nova] Creating event network-changed:73d56411-e2cc-4061-8eeb-efbbcd8b0986 for instance 7b970f17-73a6-4e13-845d-a2ead7223a67 on hv-cinder-78605 Apr 19 03:44:17.159898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-fe9e36b6-89ba-4dbe-a655-6805fcb166ff req-ef2a7990-ea78-481a-9cbf-4f522cff3939 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039167 Apr 19 03:44:17.160549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 412/841] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:44:17.477494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2cc3fbf4-fcbb-4ea8-b7d4-732041e7536e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:17.478263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2cc3fbf4-fcbb-4ea8-b7d4-732041e7536e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:17.486282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cc3fbf4-fcbb-4ea8-b7d4-732041e7536e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:17.486784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cc3fbf4-fcbb-4ea8-b7d4-732041e7536e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:17.487898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cc3fbf4-fcbb-4ea8-b7d4-732041e7536e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:17.488386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cc3fbf4-fcbb-4ea8-b7d4-732041e7536e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:17.703330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2cc3fbf4-fcbb-4ea8-b7d4-732041e7536e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:17.712725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2cc3fbf4-fcbb-4ea8-b7d4-732041e7536e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:17.714400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2cc3fbf4-fcbb-4ea8-b7d4-732041e7536e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:17.715594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2cc3fbf4-fcbb-4ea8-b7d4-732041e7536e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1407 microversion: 2.20 time: 0.243210 Apr 19 03:44:17.716205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 413/842] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:17 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:44:18.735411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ee985137-2e1f-48a7-b1f3-7e94aa7d66fe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:18.736092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ee985137-2e1f-48a7-b1f3-7e94aa7d66fe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:18.744787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee985137-2e1f-48a7-b1f3-7e94aa7d66fe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:18.745299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee985137-2e1f-48a7-b1f3-7e94aa7d66fe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:18.746142 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee985137-2e1f-48a7-b1f3-7e94aa7d66fe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:18.746641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee985137-2e1f-48a7-b1f3-7e94aa7d66fe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:18.956496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ee985137-2e1f-48a7-b1f3-7e94aa7d66fe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:18.965781 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ee985137-2e1f-48a7-b1f3-7e94aa7d66fe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:18.967473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ee985137-2e1f-48a7-b1f3-7e94aa7d66fe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:18.968617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ee985137-2e1f-48a7-b1f3-7e94aa7d66fe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1407 microversion: 2.20 time: 0.237386 Apr 19 03:44:18.969227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 414/843] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:18 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:44:19.701063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7243e4a5-ec40-46e0-9f7e-00ff25e1c797 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 38177 microversion: 2.1 time: 2.679027 Apr 19 03:44:19.701772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 430/844] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:17 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 38177 bytes in 2681 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:19.989307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2c3d28b6-8cb3-447e-950d-fea3c94a9e7e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:19.990000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2c3d28b6-8cb3-447e-950d-fea3c94a9e7e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:19.998711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c3d28b6-8cb3-447e-950d-fea3c94a9e7e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:19.999267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c3d28b6-8cb3-447e-950d-fea3c94a9e7e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:20.000108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c3d28b6-8cb3-447e-950d-fea3c94a9e7e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:20.000590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c3d28b6-8cb3-447e-950d-fea3c94a9e7e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:20.229826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2c3d28b6-8cb3-447e-950d-fea3c94a9e7e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:20.241819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2c3d28b6-8cb3-447e-950d-fea3c94a9e7e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:20.243561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2c3d28b6-8cb3-447e-950d-fea3c94a9e7e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:20.244922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2c3d28b6-8cb3-447e-950d-fea3c94a9e7e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1407 microversion: 2.20 time: 0.260225 Apr 19 03:44:20.245747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 415/845] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:19 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:20.447321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d0b2fab2-a91f-4db5-bfbf-f5cdaab5a320 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5699cd4c-a391-49a6-85cd-09fde627babe"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:20.448627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d0b2fab2-a91f-4db5-bfbf-f5cdaab5a320 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:20.456862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0b2fab2-a91f-4db5-bfbf-f5cdaab5a320 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:20.457378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0b2fab2-a91f-4db5-bfbf-f5cdaab5a320 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:20.458219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0b2fab2-a91f-4db5-bfbf-f5cdaab5a320 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:20.458715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0b2fab2-a91f-4db5-bfbf-f5cdaab5a320 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:20.714449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9025df75-b50f-41d9-90f7-8703d4d13c8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:20.715514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9025df75-b50f-41d9-90f7-8703d4d13c8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:20.723528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9025df75-b50f-41d9-90f7-8703d4d13c8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:20.724035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9025df75-b50f-41d9-90f7-8703d4d13c8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:20.724918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9025df75-b50f-41d9-90f7-8703d4d13c8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:20.726333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9025df75-b50f-41d9-90f7-8703d4d13c8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:20.839527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9025df75-b50f-41d9-90f7-8703d4d13c8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 38177 microversion: 2.1 time: 0.128392 Apr 19 03:44:20.841438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 416/846] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:20 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 38177 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:20.869698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1121873971", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452", "networks": [{"uuid": "7501e78c-0338-4342-802f-4a47cedfcb41"}]}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:20.943101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] validate_networks() for [('7501e78c-0338-4342-802f-4a47cedfcb41', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:44:21.089214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d0b2fab2-a91f-4db5-bfbf-f5cdaab5a320 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "POST /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.646773 Apr 19 03:44:21.089757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 431/847] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:44:20 2021] POST /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/os-volume_attachments => generated 194 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:21.265773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4937af92-d761-4bf7-9b29-dde7b61e39c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:21.266733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4937af92-d761-4bf7-9b29-dde7b61e39c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:21.275946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4937af92-d761-4bf7-9b29-dde7b61e39c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:21.276455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4937af92-d761-4bf7-9b29-dde7b61e39c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:21.277458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4937af92-d761-4bf7-9b29-dde7b61e39c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:21.277950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4937af92-d761-4bf7-9b29-dde7b61e39c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:21.550255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4937af92-d761-4bf7-9b29-dde7b61e39c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:21.562656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4937af92-d761-4bf7-9b29-dde7b61e39c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:21.565691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4937af92-d761-4bf7-9b29-dde7b61e39c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:21.565691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4937af92-d761-4bf7-9b29-dde7b61e39c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1407 microversion: 2.20 time: 0.305116 Apr 19 03:44:21.566555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 432/848] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:21 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:44:21.817759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:44:21.818237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:44:21.818778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:44:21.819269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:44:21.819735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:44:21.829143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:21.829701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:21.830583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:21.831123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:21.851341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Getting quotas for project 31bc321f6ebe4f21af7ed85906e23ca7. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:44:21.853566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3220d324-95fc-409a-a4c1-7815fc4c2491 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:21.854704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3220d324-95fc-409a-a4c1-7815fc4c2491 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:21.856833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Getting quotas for user 9c52bd46007e4ac6b6d4091a798424c6 and project 31bc321f6ebe4f21af7ed85906e23ca7. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:44:21.866512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3220d324-95fc-409a-a4c1-7815fc4c2491 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:21.867256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3220d324-95fc-409a-a4c1-7815fc4c2491 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:21.868181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3220d324-95fc-409a-a4c1-7815fc4c2491 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:21.868677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3220d324-95fc-409a-a4c1-7815fc4c2491 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:21.869109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:44:21.871718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:44:21.952506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7edd9855-78b9-4484-8e29-6711cd0e4d00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087975 Apr 19 03:44:21.953394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 417/849] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:44:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 19 03:44:21.964247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8023fc37-1a98-40ec-a435-5ae9efb11161 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:21.964920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8023fc37-1a98-40ec-a435-5ae9efb11161 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:21.970720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3220d324-95fc-409a-a4c1-7815fc4c2491 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 38185 microversion: 2.1 time: 0.121623 Apr 19 03:44:21.972561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 433/850] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:21 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 38185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 19 03:44:22.048948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8023fc37-1a98-40ec-a435-5ae9efb11161 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:22.057545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8023fc37-1a98-40ec-a435-5ae9efb11161 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1219 microversion: 2.1 time: 0.097112 Apr 19 03:44:22.058162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 418/851] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:21 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:22.586087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-41fcea6d-00d0-4c13-bdbe-f642739822e3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:22.586862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-41fcea6d-00d0-4c13-bdbe-f642739822e3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:22.595740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-41fcea6d-00d0-4c13-bdbe-f642739822e3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:22.596255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-41fcea6d-00d0-4c13-bdbe-f642739822e3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:22.597099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-41fcea6d-00d0-4c13-bdbe-f642739822e3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:22.597593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-41fcea6d-00d0-4c13-bdbe-f642739822e3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:22.822933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-41fcea6d-00d0-4c13-bdbe-f642739822e3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:22.832601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-41fcea6d-00d0-4c13-bdbe-f642739822e3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:22.834287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-41fcea6d-00d0-4c13-bdbe-f642739822e3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:22.835478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-41fcea6d-00d0-4c13-bdbe-f642739822e3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1407 microversion: 2.20 time: 0.254153 Apr 19 03:44:22.836293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 434/852] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:22 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:22.983672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7f8afe43-b6e4-4a5f-bcbc-1996881de08e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:22.984810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7f8afe43-b6e4-4a5f-bcbc-1996881de08e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:22.993802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f8afe43-b6e4-4a5f-bcbc-1996881de08e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:22.994304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f8afe43-b6e4-4a5f-bcbc-1996881de08e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:22.995171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f8afe43-b6e4-4a5f-bcbc-1996881de08e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:22.995652 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f8afe43-b6e4-4a5f-bcbc-1996881de08e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:23.075686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9e96b5cf-f86d-4278-9577-0697ed58babd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:23.076351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9e96b5cf-f86d-4278-9577-0697ed58babd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:23.084635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e96b5cf-f86d-4278-9577-0697ed58babd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:23.085150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e96b5cf-f86d-4278-9577-0697ed58babd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:23.085980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e96b5cf-f86d-4278-9577-0697ed58babd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:23.086475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e96b5cf-f86d-4278-9577-0697ed58babd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:23.099258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7f8afe43-b6e4-4a5f-bcbc-1996881de08e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action" status: 200 len: 38306 microversion: 2.1 time: 0.119501 Apr 19 03:44:23.100863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 419/853] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:22 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/action => generated 38306 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:23.111088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0378486c-202a-4621-b50f-32e3476c908e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:23.111757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0378486c-202a-4621-b50f-32e3476c908e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:23.120505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0378486c-202a-4621-b50f-32e3476c908e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:23.121003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0378486c-202a-4621-b50f-32e3476c908e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:23.121827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0378486c-202a-4621-b50f-32e3476c908e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:23.122310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0378486c-202a-4621-b50f-32e3476c908e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:23.182835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0378486c-202a-4621-b50f-32e3476c908e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/ips" status: 200 len: 146 microversion: 2.1 time: 0.075860 Apr 19 03:44:23.183503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 420/854] 10.222.0.25 () {58 vars in 1238 bytes} [Mon Apr 19 03:44:23 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/ips => generated 146 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:44:23.265689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9e96b5cf-f86d-4278-9577-0697ed58babd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:23.269538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9e96b5cf-f86d-4278-9577-0697ed58babd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1271 microversion: 2.1 time: 0.197790 Apr 19 03:44:23.270357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 435/855] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:23 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:23.854387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-20f71123-9949-48e9-9198-a7cd461a2f4b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:23.855182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-20f71123-9949-48e9-9198-a7cd461a2f4b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:23.863123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20f71123-9949-48e9-9198-a7cd461a2f4b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:23.863651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20f71123-9949-48e9-9198-a7cd461a2f4b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:23.864482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20f71123-9949-48e9-9198-a7cd461a2f4b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:23.864969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20f71123-9949-48e9-9198-a7cd461a2f4b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:24.078745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20f71123-9949-48e9-9198-a7cd461a2f4b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:24.088243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20f71123-9949-48e9-9198-a7cd461a2f4b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:24.089919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20f71123-9949-48e9-9198-a7cd461a2f4b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:24.091088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-20f71123-9949-48e9-9198-a7cd461a2f4b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1407 microversion: 2.20 time: 0.240923 Apr 19 03:44:24.091749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 421/856] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:23 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:24.288720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b66aa9df-004e-4189-9ea8-48c60b6cb819 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:24.289440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b66aa9df-004e-4189-9ea8-48c60b6cb819 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:24.297508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b66aa9df-004e-4189-9ea8-48c60b6cb819 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:24.298030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b66aa9df-004e-4189-9ea8-48c60b6cb819 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:24.298851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b66aa9df-004e-4189-9ea8-48c60b6cb819 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:24.299450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b66aa9df-004e-4189-9ea8-48c60b6cb819 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:24.836757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b66aa9df-004e-4189-9ea8-48c60b6cb819 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:24.842916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-34c8c671-cc11-47af-9154-8e9a77c7071e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea016622-7478-41dc-b517-a7a657ca032b"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:24.844431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-34c8c671-cc11-47af-9154-8e9a77c7071e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:24.845954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b66aa9df-004e-4189-9ea8-48c60b6cb819 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1319 microversion: 2.1 time: 0.561723 Apr 19 03:44:24.854802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34c8c671-cc11-47af-9154-8e9a77c7071e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:24.855970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34c8c671-cc11-47af-9154-8e9a77c7071e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:24.857026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34c8c671-cc11-47af-9154-8e9a77c7071e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:24.857804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34c8c671-cc11-47af-9154-8e9a77c7071e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:24.859031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 436/857] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:24 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1319 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:24.954879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-1a5f9581-687d-4416-93d9-59654a8cdaf4 req-adfe146b-03a1-4678-9d3b-79137595c15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b970f17-73a6-4e13-845d-a2ead7223a67", "name": "network-vif-plugged", "status": "completed", "tag": "73d56411-e2cc-4061-8eeb-efbbcd8b0986"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:24.956717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:24.956717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:24.978254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-1a5f9581-687d-4416-93d9-59654a8cdaf4 req-adfe146b-03a1-4678-9d3b-79137595c15f service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:24.978759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-1a5f9581-687d-4416-93d9-59654a8cdaf4 req-adfe146b-03a1-4678-9d3b-79137595c15f service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:25.006421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-1a5f9581-687d-4416-93d9-59654a8cdaf4 req-adfe146b-03a1-4678-9d3b-79137595c15f service nova] Creating event network-vif-plugged:73d56411-e2cc-4061-8eeb-efbbcd8b0986 for instance 7b970f17-73a6-4e13-845d-a2ead7223a67 on hv-cinder-78605 Apr 19 03:44:25.014118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-1a5f9581-687d-4416-93d9-59654a8cdaf4 req-adfe146b-03a1-4678-9d3b-79137595c15f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064717 Apr 19 03:44:25.016908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 437/858] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:44:25.111058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-77f082f9-e39c-4a65-bf6e-0a17d739c200 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:25.111972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-77f082f9-e39c-4a65-bf6e-0a17d739c200 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:25.120852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77f082f9-e39c-4a65-bf6e-0a17d739c200 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:25.121470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77f082f9-e39c-4a65-bf6e-0a17d739c200 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:25.122399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77f082f9-e39c-4a65-bf6e-0a17d739c200 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:25.122973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77f082f9-e39c-4a65-bf6e-0a17d739c200 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:25.541899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-34c8c671-cc11-47af-9154-8e9a77c7071e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.702697 Apr 19 03:44:25.543084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 422/859] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:44:24 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:25.866563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0542167a-8a62-4107-b929-26274a67510e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:25.867426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0542167a-8a62-4107-b929-26274a67510e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:25.877038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0542167a-8a62-4107-b929-26274a67510e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:25.877555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0542167a-8a62-4107-b929-26274a67510e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:25.878587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0542167a-8a62-4107-b929-26274a67510e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:25.879087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0542167a-8a62-4107-b929-26274a67510e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:26.094384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0542167a-8a62-4107-b929-26274a67510e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:26.103388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0542167a-8a62-4107-b929-26274a67510e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1319 microversion: 2.1 time: 0.241699 Apr 19 03:44:26.104026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 423/860] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:25 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:26.131248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-77f082f9-e39c-4a65-bf6e-0a17d739c200 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:26.140909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-77f082f9-e39c-4a65-bf6e-0a17d739c200 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:26.142523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-77f082f9-e39c-4a65-bf6e-0a17d739c200 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:26.143738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-77f082f9-e39c-4a65-bf6e-0a17d739c200 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1407 microversion: 2.20 time: 1.037364 Apr 19 03:44:26.145131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 438/861] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:25 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1407 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 03:44:26.687056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-083c4c26-43b2-4894-8465-5008a24f3d23 req-eb9e3ddc-0d04-4689-a367-09a8c90e90dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399e1abb-7255-4f6f-b038-2fbfe20f7b3e", "tag": "b227a3dd-c555-40c8-8a99-11f7d9fccca6"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:26.689987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:26.689987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:26.698932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-083c4c26-43b2-4894-8465-5008a24f3d23 req-eb9e3ddc-0d04-4689-a367-09a8c90e90dc service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:26.699633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-083c4c26-43b2-4894-8465-5008a24f3d23 req-eb9e3ddc-0d04-4689-a367-09a8c90e90dc service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:26.730537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-083c4c26-43b2-4894-8465-5008a24f3d23 req-eb9e3ddc-0d04-4689-a367-09a8c90e90dc service nova] Creating event network-changed:b227a3dd-c555-40c8-8a99-11f7d9fccca6 for instance 399e1abb-7255-4f6f-b038-2fbfe20f7b3e on hv-cinder-78605 Apr 19 03:44:26.736138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-083c4c26-43b2-4894-8465-5008a24f3d23 req-eb9e3ddc-0d04-4689-a367-09a8c90e90dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053253 Apr 19 03:44:26.736822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 424/862] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:27.121843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cdd8e387-3e83-440a-8c4e-af8faa0f6aa2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:27.122553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cdd8e387-3e83-440a-8c4e-af8faa0f6aa2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:27.130698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdd8e387-3e83-440a-8c4e-af8faa0f6aa2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:27.131317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdd8e387-3e83-440a-8c4e-af8faa0f6aa2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:27.132138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdd8e387-3e83-440a-8c4e-af8faa0f6aa2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:27.132625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdd8e387-3e83-440a-8c4e-af8faa0f6aa2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:27.163514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-789282c8-a176-4240-aab1-3f85438ac4f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:27.164565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-789282c8-a176-4240-aab1-3f85438ac4f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:27.172821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-789282c8-a176-4240-aab1-3f85438ac4f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:27.173538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-789282c8-a176-4240-aab1-3f85438ac4f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:27.174505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-789282c8-a176-4240-aab1-3f85438ac4f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:27.175072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-789282c8-a176-4240-aab1-3f85438ac4f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:27.392411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-789282c8-a176-4240-aab1-3f85438ac4f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:27.404321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-789282c8-a176-4240-aab1-3f85438ac4f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:27.406120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-789282c8-a176-4240-aab1-3f85438ac4f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:27.407750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-789282c8-a176-4240-aab1-3f85438ac4f1 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1599 microversion: 2.20 time: 0.249544 Apr 19 03:44:27.408838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 425/863] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:44:27 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1599 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:44:27.430644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fb4c3e08-50ad-4175-ba6e-f3b5cab56f64 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:27.431236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fb4c3e08-50ad-4175-ba6e-f3b5cab56f64 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:27.441364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb4c3e08-50ad-4175-ba6e-f3b5cab56f64 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:27.441878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb4c3e08-50ad-4175-ba6e-f3b5cab56f64 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:27.442739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb4c3e08-50ad-4175-ba6e-f3b5cab56f64 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:27.443770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb4c3e08-50ad-4175-ba6e-f3b5cab56f64 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:27.466562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cdd8e387-3e83-440a-8c4e-af8faa0f6aa2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:27.476073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cdd8e387-3e83-440a-8c4e-af8faa0f6aa2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1319 microversion: 2.1 time: 0.358330 Apr 19 03:44:27.476890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 439/864] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:27 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:27.607114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fb4c3e08-50ad-4175-ba6e-f3b5cab56f64 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.180882 Apr 19 03:44:27.607831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 426/865] 10.222.0.25 () {60 vars in 1306 bytes} [Mon Apr 19 03:44:27 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 19 03:44:28.494507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ba0cad9e-7c7d-4ed2-b0db-81b2771ab943 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:28.495376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ba0cad9e-7c7d-4ed2-b0db-81b2771ab943 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:28.503216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba0cad9e-7c7d-4ed2-b0db-81b2771ab943 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:28.503728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba0cad9e-7c7d-4ed2-b0db-81b2771ab943 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:28.504552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba0cad9e-7c7d-4ed2-b0db-81b2771ab943 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:28.505041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba0cad9e-7c7d-4ed2-b0db-81b2771ab943 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:28.719813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ba0cad9e-7c7d-4ed2-b0db-81b2771ab943 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:28.728575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ba0cad9e-7c7d-4ed2-b0db-81b2771ab943 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1319 microversion: 2.1 time: 0.238286 Apr 19 03:44:28.729192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 440/866] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:28 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:29.215014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c8096bc3-2434-4a2a-9c0f-6872b729825b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:29.216460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c8096bc3-2434-4a2a-9c0f-6872b729825b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:29.220942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-e3cd3669-d589-4c94-9d57-3c87bea0f7fb req-95faf45f-fd8e-4ce7-a8cd-26c059140464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b970f17-73a6-4e13-845d-a2ead7223a67", "tag": "73d56411-e2cc-4061-8eeb-efbbcd8b0986"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:29.223175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:29.223175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:29.225657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8096bc3-2434-4a2a-9c0f-6872b729825b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:29.226385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8096bc3-2434-4a2a-9c0f-6872b729825b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:29.227467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8096bc3-2434-4a2a-9c0f-6872b729825b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:29.228144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8096bc3-2434-4a2a-9c0f-6872b729825b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:29.233914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e3cd3669-d589-4c94-9d57-3c87bea0f7fb req-95faf45f-fd8e-4ce7-a8cd-26c059140464 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:29.234484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e3cd3669-d589-4c94-9d57-3c87bea0f7fb req-95faf45f-fd8e-4ce7-a8cd-26c059140464 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:29.257682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-e3cd3669-d589-4c94-9d57-3c87bea0f7fb req-95faf45f-fd8e-4ce7-a8cd-26c059140464 service nova] Creating event network-changed:73d56411-e2cc-4061-8eeb-efbbcd8b0986 for instance 7b970f17-73a6-4e13-845d-a2ead7223a67 on hv-cinder-78605 Apr 19 03:44:29.262849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-e3cd3669-d589-4c94-9d57-3c87bea0f7fb req-95faf45f-fd8e-4ce7-a8cd-26c059140464 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047037 Apr 19 03:44:29.263726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 441/867] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 03:44:29.270488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-eb966eb6-a964-44ee-bbf3-28c47ac1d94c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:29.271420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-eb966eb6-a964-44ee-bbf3-28c47ac1d94c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:29.280352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb966eb6-a964-44ee-bbf3-28c47ac1d94c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:29.280945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb966eb6-a964-44ee-bbf3-28c47ac1d94c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:29.281858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb966eb6-a964-44ee-bbf3-28c47ac1d94c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:29.282443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb966eb6-a964-44ee-bbf3-28c47ac1d94c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:29.332303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c8096bc3-2434-4a2a-9c0f-6872b729825b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 14 microversion: 2.20 time: 0.120526 Apr 19 03:44:29.333132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 427/868] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:29 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:29.639332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-eb966eb6-a964-44ee-bbf3-28c47ac1d94c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:29.649217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-eb966eb6-a964-44ee-bbf3-28c47ac1d94c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1594 microversion: 2.1 time: 0.383585 Apr 19 03:44:29.649846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 442/869] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:29 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1594 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:29.748383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b411412a-5105-4d8f-a1dd-274ac49bcb45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:29.749167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b411412a-5105-4d8f-a1dd-274ac49bcb45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:29.759109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b411412a-5105-4d8f-a1dd-274ac49bcb45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:29.759662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b411412a-5105-4d8f-a1dd-274ac49bcb45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:29.760508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b411412a-5105-4d8f-a1dd-274ac49bcb45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:29.761126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b411412a-5105-4d8f-a1dd-274ac49bcb45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:30.095626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b411412a-5105-4d8f-a1dd-274ac49bcb45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:30.108388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b411412a-5105-4d8f-a1dd-274ac49bcb45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1319 microversion: 2.1 time: 0.365202 Apr 19 03:44:30.109888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 428/870] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:29 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:30.343890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-948dc304-bd4f-435b-ab50-722af121917c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:30.345198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-948dc304-bd4f-435b-ab50-722af121917c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:30.354305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-948dc304-bd4f-435b-ab50-722af121917c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:30.355429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-948dc304-bd4f-435b-ab50-722af121917c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:30.356739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-948dc304-bd4f-435b-ab50-722af121917c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:30.357255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-948dc304-bd4f-435b-ab50-722af121917c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:30.465663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-948dc304-bd4f-435b-ab50-722af121917c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 14 microversion: 2.20 time: 0.125732 Apr 19 03:44:30.466589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 443/871] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:30 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:31.129182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b3fabab8-af36-48e3-ba5b-e5ce0f1563d9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:31.130560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b3fabab8-af36-48e3-ba5b-e5ce0f1563d9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:31.145394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3fabab8-af36-48e3-ba5b-e5ce0f1563d9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:31.146187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3fabab8-af36-48e3-ba5b-e5ce0f1563d9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:31.148754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3fabab8-af36-48e3-ba5b-e5ce0f1563d9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:31.149469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3fabab8-af36-48e3-ba5b-e5ce0f1563d9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:31.480057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5e5c3633-4d9a-4381-9d5f-e9548f5254e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:31.481672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5e5c3633-4d9a-4381-9d5f-e9548f5254e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:31.491780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e5c3633-4d9a-4381-9d5f-e9548f5254e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:31.492524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e5c3633-4d9a-4381-9d5f-e9548f5254e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:31.493537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e5c3633-4d9a-4381-9d5f-e9548f5254e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:31.494207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e5c3633-4d9a-4381-9d5f-e9548f5254e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:31.596353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b3fabab8-af36-48e3-ba5b-e5ce0f1563d9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:31.606146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5e5c3633-4d9a-4381-9d5f-e9548f5254e4 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 14 microversion: 2.20 time: 0.132051 Apr 19 03:44:31.606903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 444/872] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:31 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:31.607054 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b3fabab8-af36-48e3-ba5b-e5ce0f1563d9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1319 microversion: 2.1 time: 0.484716 Apr 19 03:44:31.608122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 429/873] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:31 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:32.619628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-546368aa-01a4-4c6d-a586-889cb58989a5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:32.620531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-546368aa-01a4-4c6d-a586-889cb58989a5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:32.625671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-828f4fa4-1c5b-430c-935d-707ce9dd3b9f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:32.626084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-828f4fa4-1c5b-430c-935d-707ce9dd3b9f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:32.629174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-546368aa-01a4-4c6d-a586-889cb58989a5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:32.629679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-546368aa-01a4-4c6d-a586-889cb58989a5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:32.630812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-546368aa-01a4-4c6d-a586-889cb58989a5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:32.631021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-546368aa-01a4-4c6d-a586-889cb58989a5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:32.634047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-828f4fa4-1c5b-430c-935d-707ce9dd3b9f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:32.634553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-828f4fa4-1c5b-430c-935d-707ce9dd3b9f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:32.635622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-828f4fa4-1c5b-430c-935d-707ce9dd3b9f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:32.635885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-828f4fa4-1c5b-430c-935d-707ce9dd3b9f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:32.727568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-546368aa-01a4-4c6d-a586-889cb58989a5 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 14 microversion: 2.20 time: 0.113016 Apr 19 03:44:32.731069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 445/874] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:32 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:32.971194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-828f4fa4-1c5b-430c-935d-707ce9dd3b9f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:32.980909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-828f4fa4-1c5b-430c-935d-707ce9dd3b9f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1319 microversion: 2.1 time: 0.359538 Apr 19 03:44:32.981752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 430/875] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:32 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:33.047433 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-c675debc-fb51-4e85-82f2-e52e21abf23b req-91089238-88c4-464f-af38-479741c713dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eebf65c-de9c-4548-aab3-63d7c52a229c", "tag": "589d1f32-cd4b-4443-9982-41cdb9265434"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:33.049111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:33.049111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:33.058969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-c675debc-fb51-4e85-82f2-e52e21abf23b req-91089238-88c4-464f-af38-479741c713dc service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:33.059938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-c675debc-fb51-4e85-82f2-e52e21abf23b req-91089238-88c4-464f-af38-479741c713dc service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:33.081213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-c675debc-fb51-4e85-82f2-e52e21abf23b req-91089238-88c4-464f-af38-479741c713dc service nova] Creating event network-changed:589d1f32-cd4b-4443-9982-41cdb9265434 for instance 0eebf65c-de9c-4548-aab3-63d7c52a229c on hv-cinder-78605 Apr 19 03:44:33.087126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-c675debc-fb51-4e85-82f2-e52e21abf23b req-91089238-88c4-464f-af38-479741c713dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044263 Apr 19 03:44:33.087934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 446/876] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:33.131183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-0a1ae47c-cc93-4a1b-96c1-967c1c276878 req-ef567de0-8d8e-4ea9-a4c6-acf2683e0026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399e1abb-7255-4f6f-b038-2fbfe20f7b3e", "name": "network-vif-plugged", "status": "completed", "tag": "b227a3dd-c555-40c8-8a99-11f7d9fccca6"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:33.133220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:33.133220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:33.142460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-0a1ae47c-cc93-4a1b-96c1-967c1c276878 req-ef567de0-8d8e-4ea9-a4c6-acf2683e0026 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:33.143124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-0a1ae47c-cc93-4a1b-96c1-967c1c276878 req-ef567de0-8d8e-4ea9-a4c6-acf2683e0026 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:33.162771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-0a1ae47c-cc93-4a1b-96c1-967c1c276878 req-ef567de0-8d8e-4ea9-a4c6-acf2683e0026 service nova] Creating event network-vif-plugged:b227a3dd-c555-40c8-8a99-11f7d9fccca6 for instance 399e1abb-7255-4f6f-b038-2fbfe20f7b3e on hv-cinder-78605 Apr 19 03:44:33.167767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-0a1ae47c-cc93-4a1b-96c1-967c1c276878 req-ef567de0-8d8e-4ea9-a4c6-acf2683e0026 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040514 Apr 19 03:44:33.168851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 431/877] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:33.743187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-744e95e1-4dd1-4185-bcc2-ad94d2a48a43 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:33.744677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-744e95e1-4dd1-4185-bcc2-ad94d2a48a43 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:33.754388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-744e95e1-4dd1-4185-bcc2-ad94d2a48a43 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:33.756380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-744e95e1-4dd1-4185-bcc2-ad94d2a48a43 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:33.757898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-744e95e1-4dd1-4185-bcc2-ad94d2a48a43 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:33.758608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-744e95e1-4dd1-4185-bcc2-ad94d2a48a43 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:33.917296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-744e95e1-4dd1-4185-bcc2-ad94d2a48a43 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 14 microversion: 2.20 time: 0.180786 Apr 19 03:44:33.920683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 447/878] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:33 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:33.999968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-25c635b9-8226-46a5-b05d-18b43f96d6f7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:34.001068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-25c635b9-8226-46a5-b05d-18b43f96d6f7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:34.009548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25c635b9-8226-46a5-b05d-18b43f96d6f7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:34.010298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25c635b9-8226-46a5-b05d-18b43f96d6f7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:34.011355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25c635b9-8226-46a5-b05d-18b43f96d6f7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:34.012002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25c635b9-8226-46a5-b05d-18b43f96d6f7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:34.253600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-25c635b9-8226-46a5-b05d-18b43f96d6f7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:34.265550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-25c635b9-8226-46a5-b05d-18b43f96d6f7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1319 microversion: 2.1 time: 0.269258 Apr 19 03:44:34.266836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 432/879] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:33 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:34.936872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ae7c3279-25df-4935-804b-71edd64ee27f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:34.939813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ae7c3279-25df-4935-804b-71edd64ee27f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:34.949168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae7c3279-25df-4935-804b-71edd64ee27f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:34.949675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae7c3279-25df-4935-804b-71edd64ee27f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:34.950550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae7c3279-25df-4935-804b-71edd64ee27f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:34.951121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae7c3279-25df-4935-804b-71edd64ee27f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:35.057327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ae7c3279-25df-4935-804b-71edd64ee27f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 14 microversion: 2.20 time: 0.132019 Apr 19 03:44:35.057996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 448/880] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:34 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:35.229691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c62a1e27-d1db-4f85-a8f4-75cd0537275f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-127193136"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:35.230324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c62a1e27-d1db-4f85-a8f4-75cd0537275f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:35.238432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c62a1e27-d1db-4f85-a8f4-75cd0537275f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:35.238934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c62a1e27-d1db-4f85-a8f4-75cd0537275f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:35.240288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c62a1e27-d1db-4f85-a8f4-75cd0537275f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:35.240777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c62a1e27-d1db-4f85-a8f4-75cd0537275f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:35.285042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-549bbe18-ceec-4506-9ced-55c2b07e02b6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:35.285744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-549bbe18-ceec-4506-9ced-55c2b07e02b6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:35.294206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-549bbe18-ceec-4506-9ced-55c2b07e02b6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:35.294709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-549bbe18-ceec-4506-9ced-55c2b07e02b6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:35.295561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-549bbe18-ceec-4506-9ced-55c2b07e02b6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:35.296048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-549bbe18-ceec-4506-9ced-55c2b07e02b6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:35.455625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.network.security_group_api [None req-c62a1e27-d1db-4f85-a8f4-75cd0537275f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Adding security group 66b36786-e00e-4b37-85ae-56630e0a8890 to port 589d1f32-cd4b-4443-9982-41cdb9265434 Apr 19 03:44:35.520453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-549bbe18-ceec-4506-9ced-55c2b07e02b6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:35.529631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-549bbe18-ceec-4506-9ced-55c2b07e02b6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1508 microversion: 2.1 time: 0.249062 Apr 19 03:44:35.530469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 449/881] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:35 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:35.550777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b8dc5653-1aeb-447b-b8a4-3a113fb41e88 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7015673-9aa6-4d92-988b-b87160196b92", "device": "/dev/sdb"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:35.551820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b8dc5653-1aeb-447b-b8a4-3a113fb41e88 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:35.560185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8dc5653-1aeb-447b-b8a4-3a113fb41e88 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:35.561014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8dc5653-1aeb-447b-b8a4-3a113fb41e88 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:35.561505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8dc5653-1aeb-447b-b8a4-3a113fb41e88 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:35.561994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8dc5653-1aeb-447b-b8a4-3a113fb41e88 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:36.040147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c62a1e27-d1db-4f85-a8f4-75cd0537275f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "POST /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/action" status: 202 len: 0 microversion: 2.1 time: 0.814537 Apr 19 03:44:36.040766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 433/882] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:35 2021] POST /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/action => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:36.046582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4f99187b-2f45-4742-8a39-ab035014cc3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:36.047954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4f99187b-2f45-4742-8a39-ab035014cc3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:36.057032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f99187b-2f45-4742-8a39-ab035014cc3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:36.057769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f99187b-2f45-4742-8a39-ab035014cc3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:36.058763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f99187b-2f45-4742-8a39-ab035014cc3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:36.059461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f99187b-2f45-4742-8a39-ab035014cc3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:36.145280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4f99187b-2f45-4742-8a39-ab035014cc3a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102764 Apr 19 03:44:36.152231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 434/883] 10.222.0.25 () {58 vars in 1292 bytes} [Mon Apr 19 03:44:36 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:36.152231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-05a2b8d2-0600-4937-9cfa-ccb421dbcc04 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:36.152231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-05a2b8d2-0600-4937-9cfa-ccb421dbcc04 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:36.160477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05a2b8d2-0600-4937-9cfa-ccb421dbcc04 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:36.160993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05a2b8d2-0600-4937-9cfa-ccb421dbcc04 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:36.162498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05a2b8d2-0600-4937-9cfa-ccb421dbcc04 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:36.162991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05a2b8d2-0600-4937-9cfa-ccb421dbcc04 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:36.171896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b8dc5653-1aeb-447b-b8a4-3a113fb41e88 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "POST /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626621 Apr 19 03:44:36.173006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 450/884] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:44:35 2021] POST /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:36.186160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-370ec7c5-4f00-461b-81cf-78260f717116 req-627d1419-d745-4d7c-8875-a4beeaf049b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eebf65c-de9c-4548-aab3-63d7c52a229c", "tag": "589d1f32-cd4b-4443-9982-41cdb9265434"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:36.188149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:44:36.188149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:44:36.202299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-370ec7c5-4f00-461b-81cf-78260f717116 req-627d1419-d745-4d7c-8875-a4beeaf049b5 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:36.203199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-370ec7c5-4f00-461b-81cf-78260f717116 req-627d1419-d745-4d7c-8875-a4beeaf049b5 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:36.225605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-370ec7c5-4f00-461b-81cf-78260f717116 req-627d1419-d745-4d7c-8875-a4beeaf049b5 service nova] Creating event network-changed:589d1f32-cd4b-4443-9982-41cdb9265434 for instance 0eebf65c-de9c-4548-aab3-63d7c52a229c on hv-cinder-78605 Apr 19 03:44:36.232151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-370ec7c5-4f00-461b-81cf-78260f717116 req-627d1419-d745-4d7c-8875-a4beeaf049b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050433 Apr 19 03:44:36.233257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 451/885] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:44:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:36.243071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-97bbec67-85ac-4cc4-8882-5c338f2ddde2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:36.246141 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-97bbec67-85ac-4cc4-8882-5c338f2ddde2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:36.259789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-97bbec67-85ac-4cc4-8882-5c338f2ddde2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:36.260574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-97bbec67-85ac-4cc4-8882-5c338f2ddde2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:36.262907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-97bbec67-85ac-4cc4-8882-5c338f2ddde2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:36.263675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-97bbec67-85ac-4cc4-8882-5c338f2ddde2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:36.382587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-97bbec67-85ac-4cc4-8882-5c338f2ddde2 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 14 microversion: 2.20 time: 0.146620 Apr 19 03:44:36.383490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 452/886] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:36 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:36.389159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ee0cc711-4c96-41a8-9e36-e89d7185f0ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:36.389975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ee0cc711-4c96-41a8-9e36-e89d7185f0ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:36.399940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee0cc711-4c96-41a8-9e36-e89d7185f0ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:36.400557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee0cc711-4c96-41a8-9e36-e89d7185f0ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:36.401765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee0cc711-4c96-41a8-9e36-e89d7185f0ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:36.402364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee0cc711-4c96-41a8-9e36-e89d7185f0ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:36.502737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ee0cc711-4c96-41a8-9e36-e89d7185f0ed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/ea016622-7478-41dc-b517-a7a657ca032b" status: 200 len: 194 microversion: 2.1 time: 0.117790 Apr 19 03:44:36.505077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 453/887] 10.222.0.25 () {58 vars in 1403 bytes} [Mon Apr 19 03:44:36 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/ea016622-7478-41dc-b517-a7a657ca032b => generated 194 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:36.573708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-05a2b8d2-0600-4937-9cfa-ccb421dbcc04 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:36.592466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-05a2b8d2-0600-4937-9cfa-ccb421dbcc04 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1759 microversion: 2.1 time: 0.444908 Apr 19 03:44:36.593115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 435/888] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:36 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1759 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:37.393814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a522ace8-142c-477f-bbd7-cb83d03a8076 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:37.395022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a522ace8-142c-477f-bbd7-cb83d03a8076 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:37.403681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a522ace8-142c-477f-bbd7-cb83d03a8076 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:37.404195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a522ace8-142c-477f-bbd7-cb83d03a8076 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:37.405082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a522ace8-142c-477f-bbd7-cb83d03a8076 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:37.405571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a522ace8-142c-477f-bbd7-cb83d03a8076 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:37.506379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a522ace8-142c-477f-bbd7-cb83d03a8076 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 14 microversion: 2.20 time: 0.116427 Apr 19 03:44:37.507280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 454/889] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:37 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:38.288980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7da334ed-a9fd-4c32-b4a3-c5e0993c4484 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb75078c-071a-4703-9026-5e35342b7eed"}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:38.290258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7da334ed-a9fd-4c32-b4a3-c5e0993c4484 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:38.298696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7da334ed-a9fd-4c32-b4a3-c5e0993c4484 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:38.299225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7da334ed-a9fd-4c32-b4a3-c5e0993c4484 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:38.300057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7da334ed-a9fd-4c32-b4a3-c5e0993c4484 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:38.300549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7da334ed-a9fd-4c32-b4a3-c5e0993c4484 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:38.518822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fa8904b2-bf61-4cc5-b462-b06aa7dfe649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:38.519988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fa8904b2-bf61-4cc5-b462-b06aa7dfe649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:38.529006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fa8904b2-bf61-4cc5-b462-b06aa7dfe649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:38.529635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fa8904b2-bf61-4cc5-b462-b06aa7dfe649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:38.530477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fa8904b2-bf61-4cc5-b462-b06aa7dfe649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:38.530969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fa8904b2-bf61-4cc5-b462-b06aa7dfe649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:38.642580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fa8904b2-bf61-4cc5-b462-b06aa7dfe649 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 14 microversion: 2.20 time: 0.128201 Apr 19 03:44:38.646108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 455/890] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:38 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:44:38.865315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7da334ed-a9fd-4c32-b4a3-c5e0993c4484 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580268 Apr 19 03:44:38.866163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 436/891] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Apr 19 03:44:38 2021] POST /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:44:39.655047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-21e0f6de-979b-45ee-a6f6-8352e52ef96d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:39.656290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-21e0f6de-979b-45ee-a6f6-8352e52ef96d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:39.664980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21e0f6de-979b-45ee-a6f6-8352e52ef96d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:39.665484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21e0f6de-979b-45ee-a6f6-8352e52ef96d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:39.666315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21e0f6de-979b-45ee-a6f6-8352e52ef96d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:39.666798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21e0f6de-979b-45ee-a6f6-8352e52ef96d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:39.781097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-21e0f6de-979b-45ee-a6f6-8352e52ef96d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 144 microversion: 2.20 time: 0.130558 Apr 19 03:44:39.781735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 456/892] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:39 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 144 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:44:40.793471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cc3b3f7b-1512-40aa-a7ff-922b765881fc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:40.794702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cc3b3f7b-1512-40aa-a7ff-922b765881fc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:40.807011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc3b3f7b-1512-40aa-a7ff-922b765881fc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:40.807550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc3b3f7b-1512-40aa-a7ff-922b765881fc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:40.808385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc3b3f7b-1512-40aa-a7ff-922b765881fc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:40.808875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc3b3f7b-1512-40aa-a7ff-922b765881fc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:40.914456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cc3b3f7b-1512-40aa-a7ff-922b765881fc tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 11535 microversion: 2.20 time: 0.125463 Apr 19 03:44:40.915114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 437/893] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:40 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 11535 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:41.926423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5c9a8719-e12a-4bf7-b513-dac9b5e50e53 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:41.927546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5c9a8719-e12a-4bf7-b513-dac9b5e50e53 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:41.936105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9a8719-e12a-4bf7-b513-dac9b5e50e53 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:41.936559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9a8719-e12a-4bf7-b513-dac9b5e50e53 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:41.937380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9a8719-e12a-4bf7-b513-dac9b5e50e53 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:41.937865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9a8719-e12a-4bf7-b513-dac9b5e50e53 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:42.054046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5c9a8719-e12a-4bf7-b513-dac9b5e50e53 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 17196 microversion: 2.20 time: 0.132158 Apr 19 03:44:42.054713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 457/894] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:41 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 17196 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:43.066819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b8b57ae2-356c-42d1-a062-9e709d01ba30 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:43.068007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b8b57ae2-356c-42d1-a062-9e709d01ba30 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:43.076605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8b57ae2-356c-42d1-a062-9e709d01ba30 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:43.077098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8b57ae2-356c-42d1-a062-9e709d01ba30 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:43.077944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8b57ae2-356c-42d1-a062-9e709d01ba30 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:43.078440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8b57ae2-356c-42d1-a062-9e709d01ba30 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:43.197885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b8b57ae2-356c-42d1-a062-9e709d01ba30 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 17717 microversion: 2.20 time: 0.135500 Apr 19 03:44:43.198783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 438/895] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:43 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 17717 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:44.211066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2308991c-622b-4c92-8941-251e48d17d8f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:44.212281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2308991c-622b-4c92-8941-251e48d17d8f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:44.220557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2308991c-622b-4c92-8941-251e48d17d8f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:44.221066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2308991c-622b-4c92-8941-251e48d17d8f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:44.221906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2308991c-622b-4c92-8941-251e48d17d8f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:44.222403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2308991c-622b-4c92-8941-251e48d17d8f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:44.324915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2308991c-622b-4c92-8941-251e48d17d8f tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 19342 microversion: 2.20 time: 0.118209 Apr 19 03:44:44.325513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 458/896] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:44 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 19342 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:45.338605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dd409ead-e6ba-46e6-b4fe-0a73896e76b3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:45.339901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dd409ead-e6ba-46e6-b4fe-0a73896e76b3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:45.348473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd409ead-e6ba-46e6-b4fe-0a73896e76b3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:45.348978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd409ead-e6ba-46e6-b4fe-0a73896e76b3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:45.349797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd409ead-e6ba-46e6-b4fe-0a73896e76b3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:45.350283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd409ead-e6ba-46e6-b4fe-0a73896e76b3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:47.828825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dd409ead-e6ba-46e6-b4fe-0a73896e76b3 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 25233 microversion: 2.20 time: 2.495052 Apr 19 03:44:47.829925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 439/897] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:45 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 25233 bytes in 2498 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:48.841697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5f02b265-c5cc-456f-b262-05d83acc1a5a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:48.842829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5f02b265-c5cc-456f-b262-05d83acc1a5a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:48.851496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f02b265-c5cc-456f-b262-05d83acc1a5a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:48.851977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f02b265-c5cc-456f-b262-05d83acc1a5a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:48.853101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f02b265-c5cc-456f-b262-05d83acc1a5a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:48.853520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f02b265-c5cc-456f-b262-05d83acc1a5a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:48.965034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5f02b265-c5cc-456f-b262-05d83acc1a5a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 26296 microversion: 2.20 time: 0.127722 Apr 19 03:44:48.965738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 459/898] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:48 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 26296 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:49.977944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-415cd2ff-2181-4e24-9fe7-ab6d5c3cc77a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:49.979097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-415cd2ff-2181-4e24-9fe7-ab6d5c3cc77a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:49.987779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-415cd2ff-2181-4e24-9fe7-ab6d5c3cc77a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:49.988298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-415cd2ff-2181-4e24-9fe7-ab6d5c3cc77a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:49.989108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-415cd2ff-2181-4e24-9fe7-ab6d5c3cc77a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:49.989598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-415cd2ff-2181-4e24-9fe7-ab6d5c3cc77a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:50.098530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-415cd2ff-2181-4e24-9fe7-ab6d5c3cc77a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 27198 microversion: 2.20 time: 0.124914 Apr 19 03:44:50.099220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 440/899] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:49 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 27198 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:51.111072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-71e1a62a-7ce3-4a6c-850d-6c585637eb32 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:51.112312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-71e1a62a-7ce3-4a6c-850d-6c585637eb32 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:51.121281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71e1a62a-7ce3-4a6c-850d-6c585637eb32 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:51.121791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71e1a62a-7ce3-4a6c-850d-6c585637eb32 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:51.122635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71e1a62a-7ce3-4a6c-850d-6c585637eb32 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:51.123136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71e1a62a-7ce3-4a6c-850d-6c585637eb32 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:51.234936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-71e1a62a-7ce3-4a6c-850d-6c585637eb32 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 27670 microversion: 2.20 time: 0.128383 Apr 19 03:44:51.235892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 460/900] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:51 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 27670 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:52.248220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-12f067ba-a152-4336-8c68-7f1986653355 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:52.249373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-12f067ba-a152-4336-8c68-7f1986653355 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:52.257948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12f067ba-a152-4336-8c68-7f1986653355 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:52.258460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12f067ba-a152-4336-8c68-7f1986653355 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:52.259324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12f067ba-a152-4336-8c68-7f1986653355 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:52.259840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12f067ba-a152-4336-8c68-7f1986653355 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:52.368712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-12f067ba-a152-4336-8c68-7f1986653355 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 27962 microversion: 2.20 time: 0.124914 Apr 19 03:44:52.369630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 441/901] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:52 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 27962 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:53.382377 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2ed89b10-7aa9-4030-865f-ec8100cc4f6d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:53.383547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2ed89b10-7aa9-4030-865f-ec8100cc4f6d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:53.392237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ed89b10-7aa9-4030-865f-ec8100cc4f6d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:53.392741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ed89b10-7aa9-4030-865f-ec8100cc4f6d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:53.393574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ed89b10-7aa9-4030-865f-ec8100cc4f6d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:53.394068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ed89b10-7aa9-4030-865f-ec8100cc4f6d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:53.508686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2ed89b10-7aa9-4030-865f-ec8100cc4f6d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 28216 microversion: 2.20 time: 0.131482 Apr 19 03:44:53.509375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 461/902] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:53 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 28216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:54.577790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-75b3e496-7a38-40a2-af01-b25f5b36150d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:54.579028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-75b3e496-7a38-40a2-af01-b25f5b36150d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:54.587160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75b3e496-7a38-40a2-af01-b25f5b36150d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:54.587724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75b3e496-7a38-40a2-af01-b25f5b36150d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:54.588557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75b3e496-7a38-40a2-af01-b25f5b36150d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:54.589048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75b3e496-7a38-40a2-af01-b25f5b36150d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:54.694214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-75b3e496-7a38-40a2-af01-b25f5b36150d tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 28216 microversion: 2.20 time: 0.176177 Apr 19 03:44:54.694865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 442/903] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:54 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 28216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:55.707272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5773162f-14c9-4f5d-967a-eec3ca94b372 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:55.708401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5773162f-14c9-4f5d-967a-eec3ca94b372 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:55.717633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5773162f-14c9-4f5d-967a-eec3ca94b372 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:55.718088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5773162f-14c9-4f5d-967a-eec3ca94b372 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:55.718910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5773162f-14c9-4f5d-967a-eec3ca94b372 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:55.719425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5773162f-14c9-4f5d-967a-eec3ca94b372 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:55.821622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5773162f-14c9-4f5d-967a-eec3ca94b372 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 28507 microversion: 2.20 time: 0.118790 Apr 19 03:44:55.822318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 462/904] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:55 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 28507 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:56.834782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6d1563d7-c106-4f4e-aca3-4cf4d8b7b20e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:56.835909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6d1563d7-c106-4f4e-aca3-4cf4d8b7b20e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:56.844434 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d1563d7-c106-4f4e-aca3-4cf4d8b7b20e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:56.844938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d1563d7-c106-4f4e-aca3-4cf4d8b7b20e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:56.845756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d1563d7-c106-4f4e-aca3-4cf4d8b7b20e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:56.846242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d1563d7-c106-4f4e-aca3-4cf4d8b7b20e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:56.948443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6d1563d7-c106-4f4e-aca3-4cf4d8b7b20e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 28675 microversion: 2.20 time: 0.118720 Apr 19 03:44:56.949124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 443/905] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:56 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 28675 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:57.145371 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0cf0751f-7f9b-4494-b38f-e0f0f9f83c9b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:57.146997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0cf0751f-7f9b-4494-b38f-e0f0f9f83c9b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:57.155599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cf0751f-7f9b-4494-b38f-e0f0f9f83c9b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:57.156108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cf0751f-7f9b-4494-b38f-e0f0f9f83c9b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:57.156934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cf0751f-7f9b-4494-b38f-e0f0f9f83c9b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:57.157426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cf0751f-7f9b-4494-b38f-e0f0f9f83c9b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:57.362044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0cf0751f-7f9b-4494-b38f-e0f0f9f83c9b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "POST /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/action" status: 202 len: 0 microversion: 2.1 time: 0.221192 Apr 19 03:44:57.363065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 463/906] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:44:57 2021] POST /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:57.373144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-22224179-6a54-4c19-8b58-201cb47bfdda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:57.373910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-22224179-6a54-4c19-8b58-201cb47bfdda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:57.383115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22224179-6a54-4c19-8b58-201cb47bfdda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:57.383655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22224179-6a54-4c19-8b58-201cb47bfdda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:57.384578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22224179-6a54-4c19-8b58-201cb47bfdda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:57.385076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22224179-6a54-4c19-8b58-201cb47bfdda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:57.613613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-22224179-6a54-4c19-8b58-201cb47bfdda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:57.623729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-22224179-6a54-4c19-8b58-201cb47bfdda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1751 microversion: 2.1 time: 0.255959 Apr 19 03:44:57.631209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 444/907] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:57 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1751 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:57.961495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7fb8509-bb0d-4b86-8a2d-fbdd33ee6dc7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:57.962685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b7fb8509-bb0d-4b86-8a2d-fbdd33ee6dc7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:57.970695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7fb8509-bb0d-4b86-8a2d-fbdd33ee6dc7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:57.971233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7fb8509-bb0d-4b86-8a2d-fbdd33ee6dc7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:57.972062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7fb8509-bb0d-4b86-8a2d-fbdd33ee6dc7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:57.972548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7fb8509-bb0d-4b86-8a2d-fbdd33ee6dc7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:58.073404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b7fb8509-bb0d-4b86-8a2d-fbdd33ee6dc7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 28675 microversion: 2.20 time: 0.116311 Apr 19 03:44:58.074289 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 464/908] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:57 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 28675 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:44:58.643439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-973add7f-bee6-4065-aaff-bc0ed51b8ac2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:44:58.644056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-973add7f-bee6-4065-aaff-bc0ed51b8ac2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:58.652929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-973add7f-bee6-4065-aaff-bc0ed51b8ac2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:58.653440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-973add7f-bee6-4065-aaff-bc0ed51b8ac2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:58.654261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-973add7f-bee6-4065-aaff-bc0ed51b8ac2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:58.654747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-973add7f-bee6-4065-aaff-bc0ed51b8ac2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:59.086688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f0af29c9-b348-48a7-b683-ab20f3ad3a70 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:44:59.087846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f0af29c9-b348-48a7-b683-ab20f3ad3a70 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:44:59.096357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0af29c9-b348-48a7-b683-ab20f3ad3a70 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:59.096858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0af29c9-b348-48a7-b683-ab20f3ad3a70 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:59.097852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0af29c9-b348-48a7-b683-ab20f3ad3a70 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:44:59.098200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0af29c9-b348-48a7-b683-ab20f3ad3a70 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:44:59.101066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-973add7f-bee6-4065-aaff-bc0ed51b8ac2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:44:59.111207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-973add7f-bee6-4065-aaff-bc0ed51b8ac2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.471988 Apr 19 03:44:59.111834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 445/909] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:44:58 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:44:59.201438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f0af29c9-b348-48a7-b683-ab20f3ad3a70 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 28675 microversion: 2.20 time: 0.119286 Apr 19 03:44:59.202123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 465/910] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:44:59 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 28675 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:45:00.130093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b0a7b2f7-ca96-4725-9815-63f519e5ab21 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:00.130752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b0a7b2f7-ca96-4725-9815-63f519e5ab21 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:00.138637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b0a7b2f7-ca96-4725-9815-63f519e5ab21 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:00.139192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b0a7b2f7-ca96-4725-9815-63f519e5ab21 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:00.140017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b0a7b2f7-ca96-4725-9815-63f519e5ab21 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:00.140510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b0a7b2f7-ca96-4725-9815-63f519e5ab21 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:00.215285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b3d5dbdb-ed1f-4a07-b6c0-2acab1353276 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:00.216477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b3d5dbdb-ed1f-4a07-b6c0-2acab1353276 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:00.224972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3d5dbdb-ed1f-4a07-b6c0-2acab1353276 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:00.225483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3d5dbdb-ed1f-4a07-b6c0-2acab1353276 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:00.226356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3d5dbdb-ed1f-4a07-b6c0-2acab1353276 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:00.226828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3d5dbdb-ed1f-4a07-b6c0-2acab1353276 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:00.327492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b3d5dbdb-ed1f-4a07-b6c0-2acab1353276 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 28675 microversion: 2.20 time: 0.116546 Apr 19 03:45:00.331693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 466/911] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:00 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 28675 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:45:00.359867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b0a7b2f7-ca96-4725-9815-63f519e5ab21 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:00.369547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b0a7b2f7-ca96-4725-9815-63f519e5ab21 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.243592 Apr 19 03:45:00.370263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 446/912] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:00 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:01.340339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-644db62d-99a6-4339-8a22-2b4f40269f31 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:01.341467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-644db62d-99a6-4339-8a22-2b4f40269f31 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:01.350645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-644db62d-99a6-4339-8a22-2b4f40269f31 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:01.351184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-644db62d-99a6-4339-8a22-2b4f40269f31 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:01.351985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-644db62d-99a6-4339-8a22-2b4f40269f31 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:01.352470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-644db62d-99a6-4339-8a22-2b4f40269f31 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:01.387897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-676d431a-3f2d-4fbf-87c9-4438b516fdcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:01.388572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-676d431a-3f2d-4fbf-87c9-4438b516fdcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:01.397432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-676d431a-3f2d-4fbf-87c9-4438b516fdcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:01.397941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-676d431a-3f2d-4fbf-87c9-4438b516fdcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:01.398768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-676d431a-3f2d-4fbf-87c9-4438b516fdcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:01.399278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-676d431a-3f2d-4fbf-87c9-4438b516fdcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:01.463872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-644db62d-99a6-4339-8a22-2b4f40269f31 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 30068 microversion: 2.20 time: 0.128010 Apr 19 03:45:01.464803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 467/913] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:01 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 30068 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:01.613749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-676d431a-3f2d-4fbf-87c9-4438b516fdcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:01.623260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-676d431a-3f2d-4fbf-87c9-4438b516fdcd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.239431 Apr 19 03:45:01.623879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 447/914] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:01 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:02.477403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8b100fac-9bf6-4021-b9db-93459757f540 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:02.478540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8b100fac-9bf6-4021-b9db-93459757f540 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:02.486986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b100fac-9bf6-4021-b9db-93459757f540 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:02.487583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b100fac-9bf6-4021-b9db-93459757f540 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:02.488672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b100fac-9bf6-4021-b9db-93459757f540 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:02.489165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b100fac-9bf6-4021-b9db-93459757f540 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:02.600564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8b100fac-9bf6-4021-b9db-93459757f540 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 31781 microversion: 2.20 time: 0.128102 Apr 19 03:45:02.601326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 468/915] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:02 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 31781 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:02.641712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b85b2469-c5fa-4d5c-aa6c-9b0465abc5ca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:02.642312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b85b2469-c5fa-4d5c-aa6c-9b0465abc5ca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:02.650116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b85b2469-c5fa-4d5c-aa6c-9b0465abc5ca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:02.650612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b85b2469-c5fa-4d5c-aa6c-9b0465abc5ca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:02.651458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b85b2469-c5fa-4d5c-aa6c-9b0465abc5ca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:02.651939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b85b2469-c5fa-4d5c-aa6c-9b0465abc5ca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:02.866460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b85b2469-c5fa-4d5c-aa6c-9b0465abc5ca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:02.875775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b85b2469-c5fa-4d5c-aa6c-9b0465abc5ca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.238158 Apr 19 03:45:02.876386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 448/916] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:02 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:03.614098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2296ae5d-865d-469a-b28a-d31bd9606abd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:03.615761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2296ae5d-865d-469a-b28a-d31bd9606abd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:03.624314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2296ae5d-865d-469a-b28a-d31bd9606abd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:03.624821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2296ae5d-865d-469a-b28a-d31bd9606abd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:03.625648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2296ae5d-865d-469a-b28a-d31bd9606abd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:03.626138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2296ae5d-865d-469a-b28a-d31bd9606abd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:03.740605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2296ae5d-865d-469a-b28a-d31bd9606abd tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 33096 microversion: 2.20 time: 0.130787 Apr 19 03:45:03.741288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 469/917] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:03 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 33096 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:03.894084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-89d609cf-80bc-40e3-8a77-b66b232e4c46 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:03.894688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-89d609cf-80bc-40e3-8a77-b66b232e4c46 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:03.902579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89d609cf-80bc-40e3-8a77-b66b232e4c46 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:03.903074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89d609cf-80bc-40e3-8a77-b66b232e4c46 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:03.903923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89d609cf-80bc-40e3-8a77-b66b232e4c46 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:03.904406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89d609cf-80bc-40e3-8a77-b66b232e4c46 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:04.119055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-89d609cf-80bc-40e3-8a77-b66b232e4c46 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:04.128542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-89d609cf-80bc-40e3-8a77-b66b232e4c46 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.238673 Apr 19 03:45:04.129162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 449/918] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:03 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:04.753314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-22a6bc97-8575-4434-b3bd-718ee12bdbbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:04.754561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-22a6bc97-8575-4434-b3bd-718ee12bdbbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:04.763785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22a6bc97-8575-4434-b3bd-718ee12bdbbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:04.764302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22a6bc97-8575-4434-b3bd-718ee12bdbbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:04.765140 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22a6bc97-8575-4434-b3bd-718ee12bdbbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:04.765704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22a6bc97-8575-4434-b3bd-718ee12bdbbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:04.872079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-22a6bc97-8575-4434-b3bd-718ee12bdbbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 33774 microversion: 2.20 time: 0.123164 Apr 19 03:45:04.872696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 470/919] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:04 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 33774 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:05.146626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f6126964-2159-4ba8-8a34-7bad4a8c6bad tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:05.147268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f6126964-2159-4ba8-8a34-7bad4a8c6bad tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:05.155110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f6126964-2159-4ba8-8a34-7bad4a8c6bad tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:05.155669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f6126964-2159-4ba8-8a34-7bad4a8c6bad tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:05.156493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f6126964-2159-4ba8-8a34-7bad4a8c6bad tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:05.156981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f6126964-2159-4ba8-8a34-7bad4a8c6bad tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:05.373374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f6126964-2159-4ba8-8a34-7bad4a8c6bad tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:05.383486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f6126964-2159-4ba8-8a34-7bad4a8c6bad tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.241004 Apr 19 03:45:05.384109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 450/920] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:05 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:05.884520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c7a9d235-693f-4504-934e-79b136add4be tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:05.885657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c7a9d235-693f-4504-934e-79b136add4be tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:05.894144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c7a9d235-693f-4504-934e-79b136add4be tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:05.894647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c7a9d235-693f-4504-934e-79b136add4be tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:05.895496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c7a9d235-693f-4504-934e-79b136add4be tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:05.896478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c7a9d235-693f-4504-934e-79b136add4be tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:05.999872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c7a9d235-693f-4504-934e-79b136add4be tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 34899 microversion: 2.20 time: 0.119754 Apr 19 03:45:06.000612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 471/921] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:05 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 34899 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:06.402129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d5f0ea71-ded0-46fb-b714-1e2c1f5978f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:06.402797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d5f0ea71-ded0-46fb-b714-1e2c1f5978f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:06.411092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5f0ea71-ded0-46fb-b714-1e2c1f5978f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:06.411644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5f0ea71-ded0-46fb-b714-1e2c1f5978f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:06.412468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5f0ea71-ded0-46fb-b714-1e2c1f5978f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:06.412952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5f0ea71-ded0-46fb-b714-1e2c1f5978f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:06.627684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d5f0ea71-ded0-46fb-b714-1e2c1f5978f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:06.637655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d5f0ea71-ded0-46fb-b714-1e2c1f5978f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.239602 Apr 19 03:45:06.638283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 451/922] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:06 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:07.013234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-eb53d142-efcc-4bb0-a2d8-e4993a2cb3ac tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:07.014365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-eb53d142-efcc-4bb0-a2d8-e4993a2cb3ac tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:07.022906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb53d142-efcc-4bb0-a2d8-e4993a2cb3ac tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:07.023443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb53d142-efcc-4bb0-a2d8-e4993a2cb3ac tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:07.024271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb53d142-efcc-4bb0-a2d8-e4993a2cb3ac tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:07.024759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eb53d142-efcc-4bb0-a2d8-e4993a2cb3ac tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:07.123942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-eb53d142-efcc-4bb0-a2d8-e4993a2cb3ac tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 36260 microversion: 2.20 time: 0.115093 Apr 19 03:45:07.124633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 472/923] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:07 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 36260 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:07.655852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1a2e3da9-5c2d-4d18-b0b6-383de51e729e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:07.656572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1a2e3da9-5c2d-4d18-b0b6-383de51e729e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:07.664423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1a2e3da9-5c2d-4d18-b0b6-383de51e729e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:07.664926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1a2e3da9-5c2d-4d18-b0b6-383de51e729e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:07.665756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1a2e3da9-5c2d-4d18-b0b6-383de51e729e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:07.666242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1a2e3da9-5c2d-4d18-b0b6-383de51e729e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:07.880335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1a2e3da9-5c2d-4d18-b0b6-383de51e729e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:07.890185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1a2e3da9-5c2d-4d18-b0b6-383de51e729e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.238371 Apr 19 03:45:07.890799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 452/924] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:07 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:08.137595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5efc520c-03d7-4719-9ede-284455261776 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:08.138668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5efc520c-03d7-4719-9ede-284455261776 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:08.147311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5efc520c-03d7-4719-9ede-284455261776 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:08.147823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5efc520c-03d7-4719-9ede-284455261776 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:08.148666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5efc520c-03d7-4719-9ede-284455261776 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:08.149158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5efc520c-03d7-4719-9ede-284455261776 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:08.252801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5efc520c-03d7-4719-9ede-284455261776 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 37938 microversion: 2.20 time: 0.119662 Apr 19 03:45:08.253796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 473/925] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:08 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 37938 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:08.909162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c1284803-4d5d-4a48-9dfe-c97208933f96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:08.909828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c1284803-4d5d-4a48-9dfe-c97208933f96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:08.918196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1284803-4d5d-4a48-9dfe-c97208933f96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:08.918696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1284803-4d5d-4a48-9dfe-c97208933f96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:08.919545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1284803-4d5d-4a48-9dfe-c97208933f96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:08.920034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1284803-4d5d-4a48-9dfe-c97208933f96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:09.134545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c1284803-4d5d-4a48-9dfe-c97208933f96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:09.143956 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c1284803-4d5d-4a48-9dfe-c97208933f96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.238800 Apr 19 03:45:09.144568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 453/926] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:08 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:09.267028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-df493259-5c58-4c1b-a48e-7723d3daa411 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:09.268248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-df493259-5c58-4c1b-a48e-7723d3daa411 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:09.277429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df493259-5c58-4c1b-a48e-7723d3daa411 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:09.277964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df493259-5c58-4c1b-a48e-7723d3daa411 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:09.278780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df493259-5c58-4c1b-a48e-7723d3daa411 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:09.279300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df493259-5c58-4c1b-a48e-7723d3daa411 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:09.382345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-df493259-5c58-4c1b-a48e-7723d3daa411 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 38231 microversion: 2.20 time: 0.119909 Apr 19 03:45:09.382964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 474/927] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:09 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 38231 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:10.163422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-389c4fa3-0871-49e6-99c4-26f569c5b4ce tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:10.164040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-389c4fa3-0871-49e6-99c4-26f569c5b4ce tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:10.171910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-389c4fa3-0871-49e6-99c4-26f569c5b4ce tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:10.172414 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-389c4fa3-0871-49e6-99c4-26f569c5b4ce tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:10.173243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-389c4fa3-0871-49e6-99c4-26f569c5b4ce tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:10.173731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-389c4fa3-0871-49e6-99c4-26f569c5b4ce tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:10.388861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-389c4fa3-0871-49e6-99c4-26f569c5b4ce tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:10.395243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ef4b81b7-880e-41db-b3a0-d8253c1d522a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:10.396400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ef4b81b7-880e-41db-b3a0-d8253c1d522a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:10.398893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-389c4fa3-0871-49e6-99c4-26f569c5b4ce tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.240200 Apr 19 03:45:10.399553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 454/928] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:10 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:10.405607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef4b81b7-880e-41db-b3a0-d8253c1d522a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:10.406122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef4b81b7-880e-41db-b3a0-d8253c1d522a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:10.406996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef4b81b7-880e-41db-b3a0-d8253c1d522a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:10.407496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ef4b81b7-880e-41db-b3a0-d8253c1d522a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:10.504571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ef4b81b7-880e-41db-b3a0-d8253c1d522a tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 38231 microversion: 2.20 time: 0.113996 Apr 19 03:45:10.505257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 475/929] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:10 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 38231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:11.418084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bbff239c-cc19-41e9-957c-7140d8e68462 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:11.418757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bbff239c-cc19-41e9-957c-7140d8e68462 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:11.426653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbff239c-cc19-41e9-957c-7140d8e68462 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:11.427174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbff239c-cc19-41e9-957c-7140d8e68462 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:11.428029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbff239c-cc19-41e9-957c-7140d8e68462 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:11.429167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbff239c-cc19-41e9-957c-7140d8e68462 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:11.518025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-62c59c3f-82c1-49ad-9f79-db7b44c32c4c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:11.519325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-62c59c3f-82c1-49ad-9f79-db7b44c32c4c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:11.527976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-62c59c3f-82c1-49ad-9f79-db7b44c32c4c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:11.528491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-62c59c3f-82c1-49ad-9f79-db7b44c32c4c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:11.529323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-62c59c3f-82c1-49ad-9f79-db7b44c32c4c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:11.529817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-62c59c3f-82c1-49ad-9f79-db7b44c32c4c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:11.627943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-62c59c3f-82c1-49ad-9f79-db7b44c32c4c tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 38231 microversion: 2.20 time: 0.114422 Apr 19 03:45:11.628911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 476/930] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:11 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 38231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 19 03:45:11.647882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bbff239c-cc19-41e9-957c-7140d8e68462 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:11.657375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bbff239c-cc19-41e9-957c-7140d8e68462 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.243473 Apr 19 03:45:11.657993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 455/931] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:11 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:12.641515 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e63f9b95-a09c-42be-8571-9562a0f74e55 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:12.642709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e63f9b95-a09c-42be-8571-9562a0f74e55 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:12.651358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e63f9b95-a09c-42be-8571-9562a0f74e55 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:12.651874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e63f9b95-a09c-42be-8571-9562a0f74e55 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:12.652708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e63f9b95-a09c-42be-8571-9562a0f74e55 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:12.653207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e63f9b95-a09c-42be-8571-9562a0f74e55 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:12.675903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-990d3c76-6290-4894-b8eb-a294503a6250 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:12.676621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-990d3c76-6290-4894-b8eb-a294503a6250 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:12.685083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-990d3c76-6290-4894-b8eb-a294503a6250 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:12.685592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-990d3c76-6290-4894-b8eb-a294503a6250 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:12.686438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-990d3c76-6290-4894-b8eb-a294503a6250 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:12.686909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-990d3c76-6290-4894-b8eb-a294503a6250 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:12.754973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e63f9b95-a09c-42be-8571-9562a0f74e55 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action" status: 200 len: 38374 microversion: 2.20 time: 0.118118 Apr 19 03:45:12.761425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 477/932] 10.222.0.25 () {62 vars in 1309 bytes} [Mon Apr 19 03:45:12 2021] POST /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/action => generated 38374 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:12.767182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-09233daf-bf5f-4372-beed-f03a721e4f3b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:12.767828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-09233daf-bf5f-4372-beed-f03a721e4f3b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:12.777213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09233daf-bf5f-4372-beed-f03a721e4f3b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:12.777720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09233daf-bf5f-4372-beed-f03a721e4f3b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:12.778556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09233daf-bf5f-4372-beed-f03a721e4f3b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:12.779050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09233daf-bf5f-4372-beed-f03a721e4f3b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:12.840527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-09233daf-bf5f-4372-beed-f03a721e4f3b tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/ips" status: 200 len: 152 microversion: 2.20 time: 0.077540 Apr 19 03:45:12.841171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 478/933] 10.222.0.25 () {60 vars in 1279 bytes} [Mon Apr 19 03:45:12 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67/ips => generated 152 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 03:45:12.904150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-990d3c76-6290-4894-b8eb-a294503a6250 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:12.918456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-990d3c76-6290-4894-b8eb-a294503a6250 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.246547 Apr 19 03:45:12.919087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 456/934] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:12 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:13.937295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b07ba637-216f-4c3b-8b09-9dbea6a85845 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:13.937949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b07ba637-216f-4c3b-8b09-9dbea6a85845 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:13.946729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b07ba637-216f-4c3b-8b09-9dbea6a85845 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:13.947267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b07ba637-216f-4c3b-8b09-9dbea6a85845 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:13.948079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b07ba637-216f-4c3b-8b09-9dbea6a85845 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:13.948556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b07ba637-216f-4c3b-8b09-9dbea6a85845 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:14.205267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b07ba637-216f-4c3b-8b09-9dbea6a85845 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:14.215293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b07ba637-216f-4c3b-8b09-9dbea6a85845 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1756 microversion: 2.1 time: 0.282130 Apr 19 03:45:14.216092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 479/935] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:13 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1756 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:15.233404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b034a3b2-0ec4-475c-a4b7-f4c7fba027e1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:15.234017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b034a3b2-0ec4-475c-a4b7-f4c7fba027e1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:15.242872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b034a3b2-0ec4-475c-a4b7-f4c7fba027e1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:15.243445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b034a3b2-0ec4-475c-a4b7-f4c7fba027e1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:15.244292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b034a3b2-0ec4-475c-a4b7-f4c7fba027e1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:15.244786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b034a3b2-0ec4-475c-a4b7-f4c7fba027e1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:15.458171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b034a3b2-0ec4-475c-a4b7-f4c7fba027e1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:15.468236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b034a3b2-0ec4-475c-a4b7-f4c7fba027e1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1759 microversion: 2.1 time: 0.238953 Apr 19 03:45:15.468839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 457/936] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:15 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1759 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:15.914710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-de185f94-841a-4e53-a100-a160034a3897 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:15.915280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-de185f94-841a-4e53-a100-a160034a3897 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:15.923065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de185f94-841a-4e53-a100-a160034a3897 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:15.923599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de185f94-841a-4e53-a100-a160034a3897 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:15.924420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de185f94-841a-4e53-a100-a160034a3897 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:15.924904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de185f94-841a-4e53-a100-a160034a3897 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:15.987276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-de185f94-841a-4e53-a100-a160034a3897 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lazy-loading 'flavor' on Instance uuid 3cc5cf11-07e5-4749-b662-5d41fef38609 {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:45:15.992793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5f58d0df-e4da-4c6f-ad9b-f74ae897d194 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:15.993346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5f58d0df-e4da-4c6f-ad9b-f74ae897d194 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:16.002549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f58d0df-e4da-4c6f-ad9b-f74ae897d194 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:16.003061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f58d0df-e4da-4c6f-ad9b-f74ae897d194 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:16.003927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f58d0df-e4da-4c6f-ad9b-f74ae897d194 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:16.004424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f58d0df-e4da-4c6f-ad9b-f74ae897d194 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:16.073914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5f58d0df-e4da-4c6f-ad9b-f74ae897d194 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:45:16.255222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-de185f94-841a-4e53-a100-a160034a3897 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "POST /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609/action" status: 202 len: 0 microversion: 2.1 time: 0.344483 Apr 19 03:45:16.256078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 480/937] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:45:15 2021] POST /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:16.266355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9163dbdb-946d-49e4-878c-cc54be70f07c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:16.266570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5f58d0df-e4da-4c6f-ad9b-f74ae897d194 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 204 len: 0 microversion: 2.1 time: 0.277424 Apr 19 03:45:16.267166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 458/938] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:45:15 2021] DELETE /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:45:16.267296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9163dbdb-946d-49e4-878c-cc54be70f07c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:16.275855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9163dbdb-946d-49e4-878c-cc54be70f07c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:16.276358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9163dbdb-946d-49e4-878c-cc54be70f07c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:16.276824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d97a1eaa-ed85-46c4-92b7-e70248b83627 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:16.277196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9163dbdb-946d-49e4-878c-cc54be70f07c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:16.277691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9163dbdb-946d-49e4-878c-cc54be70f07c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:16.277849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d97a1eaa-ed85-46c4-92b7-e70248b83627 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:16.287187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d97a1eaa-ed85-46c4-92b7-e70248b83627 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:16.294360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d97a1eaa-ed85-46c4-92b7-e70248b83627 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:16.294360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d97a1eaa-ed85-46c4-92b7-e70248b83627 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:16.294360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d97a1eaa-ed85-46c4-92b7-e70248b83627 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:16.499635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9163dbdb-946d-49e4-878c-cc54be70f07c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:16.507089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d97a1eaa-ed85-46c4-92b7-e70248b83627 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:16.509661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9163dbdb-946d-49e4-878c-cc54be70f07c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.247868 Apr 19 03:45:16.510305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 481/939] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:16 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:16.516396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d97a1eaa-ed85-46c4-92b7-e70248b83627 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.244797 Apr 19 03:45:16.517014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 459/940] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:16 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:17.527661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4f95face-c829-4d9f-a789-9a5b8c9e2fd1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:17.528334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4f95face-c829-4d9f-a789-9a5b8c9e2fd1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:17.535038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7004b8e2-f787-4957-b59f-3294d9147e1e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:17.535609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7004b8e2-f787-4957-b59f-3294d9147e1e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:17.536338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f95face-c829-4d9f-a789-9a5b8c9e2fd1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:17.536846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f95face-c829-4d9f-a789-9a5b8c9e2fd1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:17.538203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f95face-c829-4d9f-a789-9a5b8c9e2fd1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:17.538762 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f95face-c829-4d9f-a789-9a5b8c9e2fd1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:17.550812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7004b8e2-f787-4957-b59f-3294d9147e1e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:17.551488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7004b8e2-f787-4957-b59f-3294d9147e1e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:17.552336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7004b8e2-f787-4957-b59f-3294d9147e1e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:17.552821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7004b8e2-f787-4957-b59f-3294d9147e1e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:17.776631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7004b8e2-f787-4957-b59f-3294d9147e1e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:17.776919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4f95face-c829-4d9f-a789-9a5b8c9e2fd1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:17.785907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7004b8e2-f787-4957-b59f-3294d9147e1e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.256011 Apr 19 03:45:17.786088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4f95face-c829-4d9f-a789-9a5b8c9e2fd1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.262434 Apr 19 03:45:17.786637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 460/941] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:17 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:17.786861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 482/942] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:17 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:18.805326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-03057601-a532-4ad0-9020-d07f3cd3caf0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:18.805992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-03057601-a532-4ad0-9020-d07f3cd3caf0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:18.813861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-03057601-a532-4ad0-9020-d07f3cd3caf0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:18.814364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-03057601-a532-4ad0-9020-d07f3cd3caf0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:18.815212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-03057601-a532-4ad0-9020-d07f3cd3caf0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:18.815701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-03057601-a532-4ad0-9020-d07f3cd3caf0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:18.856581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-81e75c94-0848-4796-bb15-2d5106f0c8dd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:18.857392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-81e75c94-0848-4796-bb15-2d5106f0c8dd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:18.866179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81e75c94-0848-4796-bb15-2d5106f0c8dd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:18.866630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81e75c94-0848-4796-bb15-2d5106f0c8dd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:18.867563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81e75c94-0848-4796-bb15-2d5106f0c8dd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:18.868249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-81e75c94-0848-4796-bb15-2d5106f0c8dd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:19.028306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-03057601-a532-4ad0-9020-d07f3cd3caf0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:19.037143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-03057601-a532-4ad0-9020-d07f3cd3caf0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.236485 Apr 19 03:45:19.038262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 461/943] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:18 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:19.078270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-81e75c94-0848-4796-bb15-2d5106f0c8dd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:19.087309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-81e75c94-0848-4796-bb15-2d5106f0c8dd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.234880 Apr 19 03:45:19.087924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 483/944] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:18 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:20.056226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f34cd884-cda9-488f-b639-739b9d2ff889 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:20.056893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f34cd884-cda9-488f-b639-739b9d2ff889 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:20.064719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f34cd884-cda9-488f-b639-739b9d2ff889 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:20.065225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f34cd884-cda9-488f-b639-739b9d2ff889 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:20.066058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f34cd884-cda9-488f-b639-739b9d2ff889 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:20.066549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f34cd884-cda9-488f-b639-739b9d2ff889 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:20.105051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bba6fd25-e32f-4ea2-9f74-823fdd14acd6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:20.105774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bba6fd25-e32f-4ea2-9f74-823fdd14acd6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:20.114360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bba6fd25-e32f-4ea2-9f74-823fdd14acd6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:20.114863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bba6fd25-e32f-4ea2-9f74-823fdd14acd6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:20.116238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bba6fd25-e32f-4ea2-9f74-823fdd14acd6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:20.116726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bba6fd25-e32f-4ea2-9f74-823fdd14acd6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:20.282929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f34cd884-cda9-488f-b639-739b9d2ff889 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:20.292727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f34cd884-cda9-488f-b639-739b9d2ff889 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.241041 Apr 19 03:45:20.293598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 462/945] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:20 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:20.563957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bba6fd25-e32f-4ea2-9f74-823fdd14acd6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:20.573138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bba6fd25-e32f-4ea2-9f74-823fdd14acd6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.472245 Apr 19 03:45:20.573770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 484/946] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:20 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:21.079708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-018397c3-a9a6-4fec-bb6b-2e65c8f6a7b2 req-81344d88-b420-456b-a0fe-e7beded640c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e2695b-dd12-444c-8d09-a65518f70b76", "name": "network-vif-unplugged", "status": "completed", "tag": "cdee7d9f-4c20-4572-8d6d-32ffe46d4cfe"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:21.081400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:45:21.081400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:45:21.090714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-018397c3-a9a6-4fec-bb6b-2e65c8f6a7b2 req-81344d88-b420-456b-a0fe-e7beded640c7 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:21.100610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-018397c3-a9a6-4fec-bb6b-2e65c8f6a7b2 req-81344d88-b420-456b-a0fe-e7beded640c7 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:21.108871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-018397c3-a9a6-4fec-bb6b-2e65c8f6a7b2 req-81344d88-b420-456b-a0fe-e7beded640c7 service nova] Creating event network-vif-unplugged:cdee7d9f-4c20-4572-8d6d-32ffe46d4cfe for instance b1e2695b-dd12-444c-8d09-a65518f70b76 on hv-cinder-78605 Apr 19 03:45:21.114319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-018397c3-a9a6-4fec-bb6b-2e65c8f6a7b2 req-81344d88-b420-456b-a0fe-e7beded640c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038938 Apr 19 03:45:21.115299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 463/947] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:45:21 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:45:21.311007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-763d2832-4931-46f9-affd-fb6835769b95 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:21.311647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-763d2832-4931-46f9-affd-fb6835769b95 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:21.319953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-763d2832-4931-46f9-affd-fb6835769b95 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:21.320460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-763d2832-4931-46f9-affd-fb6835769b95 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:21.321278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-763d2832-4931-46f9-affd-fb6835769b95 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:21.321764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-763d2832-4931-46f9-affd-fb6835769b95 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:21.537663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-763d2832-4931-46f9-affd-fb6835769b95 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:21.546806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-763d2832-4931-46f9-affd-fb6835769b95 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.239874 Apr 19 03:45:21.547471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 485/948] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:21 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:21.592672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e1ae5fef-75f6-4333-aff9-7b13ac9127d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:21.593376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e1ae5fef-75f6-4333-aff9-7b13ac9127d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:21.601447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1ae5fef-75f6-4333-aff9-7b13ac9127d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:21.601922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1ae5fef-75f6-4333-aff9-7b13ac9127d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:21.602744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1ae5fef-75f6-4333-aff9-7b13ac9127d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:21.603270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1ae5fef-75f6-4333-aff9-7b13ac9127d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:21.814711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e1ae5fef-75f6-4333-aff9-7b13ac9127d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:21.824311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e1ae5fef-75f6-4333-aff9-7b13ac9127d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.236478 Apr 19 03:45:21.824925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 464/949] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:21 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:22.565439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f8b2c9a5-4881-4ebb-8c07-ec81895387dd tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:22.566104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f8b2c9a5-4881-4ebb-8c07-ec81895387dd tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:22.573935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8b2c9a5-4881-4ebb-8c07-ec81895387dd tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:22.574438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8b2c9a5-4881-4ebb-8c07-ec81895387dd tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:22.575284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8b2c9a5-4881-4ebb-8c07-ec81895387dd tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:22.575773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8b2c9a5-4881-4ebb-8c07-ec81895387dd tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:22.784335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f8b2c9a5-4881-4ebb-8c07-ec81895387dd tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:22.793413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f8b2c9a5-4881-4ebb-8c07-ec81895387dd tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.232174 Apr 19 03:45:22.794033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 486/950] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:22 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:22.842541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c8ab4456-90f1-4a91-ad84-8036f48c1769 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:22.843293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c8ab4456-90f1-4a91-ad84-8036f48c1769 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:22.851130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8ab4456-90f1-4a91-ad84-8036f48c1769 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:22.851697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8ab4456-90f1-4a91-ad84-8036f48c1769 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:22.853552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8ab4456-90f1-4a91-ad84-8036f48c1769 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:22.854045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8ab4456-90f1-4a91-ad84-8036f48c1769 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:23.068154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c8ab4456-90f1-4a91-ad84-8036f48c1769 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:23.077908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c8ab4456-90f1-4a91-ad84-8036f48c1769 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.239492 Apr 19 03:45:23.078512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 465/951] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:22 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:23.811523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-32bb324b-68ad-4970-ba6e-cefa5e616dd7 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:23.812193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-32bb324b-68ad-4970-ba6e-cefa5e616dd7 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:23.820059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-32bb324b-68ad-4970-ba6e-cefa5e616dd7 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:23.820572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-32bb324b-68ad-4970-ba6e-cefa5e616dd7 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:23.821399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-32bb324b-68ad-4970-ba6e-cefa5e616dd7 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:23.821887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-32bb324b-68ad-4970-ba6e-cefa5e616dd7 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:24.034443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-32bb324b-68ad-4970-ba6e-cefa5e616dd7 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:24.043923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-32bb324b-68ad-4970-ba6e-cefa5e616dd7 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.236560 Apr 19 03:45:24.044570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 487/952] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:23 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:24.096143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-08c94fe9-6615-4c0f-a19f-8b787b2f28d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:24.102568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-08c94fe9-6615-4c0f-a19f-8b787b2f28d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:24.105284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08c94fe9-6615-4c0f-a19f-8b787b2f28d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:24.105795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08c94fe9-6615-4c0f-a19f-8b787b2f28d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:24.106626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08c94fe9-6615-4c0f-a19f-8b787b2f28d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:24.107133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08c94fe9-6615-4c0f-a19f-8b787b2f28d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:24.320398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-08c94fe9-6615-4c0f-a19f-8b787b2f28d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:24.329418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-08c94fe9-6615-4c0f-a19f-8b787b2f28d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.237386 Apr 19 03:45:24.330030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 466/953] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:24 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:25.062076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7c1d8727-8875-430e-a5b3-c128ac66742e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:25.062726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7c1d8727-8875-430e-a5b3-c128ac66742e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:25.070452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c1d8727-8875-430e-a5b3-c128ac66742e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:25.070937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c1d8727-8875-430e-a5b3-c128ac66742e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:25.071800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c1d8727-8875-430e-a5b3-c128ac66742e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:25.072285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c1d8727-8875-430e-a5b3-c128ac66742e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:25.348355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-78f5c870-991f-4f45-9981-8083e71b6cad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:25.349290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-78f5c870-991f-4f45-9981-8083e71b6cad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:25.358282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-78f5c870-991f-4f45-9981-8083e71b6cad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:25.358794 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-78f5c870-991f-4f45-9981-8083e71b6cad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:25.359689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-78f5c870-991f-4f45-9981-8083e71b6cad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:25.360177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-78f5c870-991f-4f45-9981-8083e71b6cad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:25.382260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7c1d8727-8875-430e-a5b3-c128ac66742e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:25.393947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7c1d8727-8875-430e-a5b3-c128ac66742e tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.336102 Apr 19 03:45:25.394769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 488/954] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:25 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:25.577430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-78f5c870-991f-4f45-9981-8083e71b6cad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:25.587007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-78f5c870-991f-4f45-9981-8083e71b6cad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.242786 Apr 19 03:45:25.587661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 467/955] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:25 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:26.413274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c46b89f0-70c7-46ee-a47d-94ac86b67246 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:26.413939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c46b89f0-70c7-46ee-a47d-94ac86b67246 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:26.421802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c46b89f0-70c7-46ee-a47d-94ac86b67246 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:26.422309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c46b89f0-70c7-46ee-a47d-94ac86b67246 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:26.423130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c46b89f0-70c7-46ee-a47d-94ac86b67246 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:26.423642 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c46b89f0-70c7-46ee-a47d-94ac86b67246 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:26.606269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c2e4a0e1-4096-4a62-971c-5e986d31857d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:26.606983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c2e4a0e1-4096-4a62-971c-5e986d31857d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:26.615108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2e4a0e1-4096-4a62-971c-5e986d31857d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:26.616199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2e4a0e1-4096-4a62-971c-5e986d31857d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:26.617032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2e4a0e1-4096-4a62-971c-5e986d31857d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:26.617520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2e4a0e1-4096-4a62-971c-5e986d31857d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:26.795294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c46b89f0-70c7-46ee-a47d-94ac86b67246 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:26.804676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c46b89f0-70c7-46ee-a47d-94ac86b67246 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.395965 Apr 19 03:45:26.805442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 489/956] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:26 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:26.832302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c2e4a0e1-4096-4a62-971c-5e986d31857d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:26.842001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c2e4a0e1-4096-4a62-971c-5e986d31857d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.239908 Apr 19 03:45:26.842623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 468/957] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:26 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:27.823971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6c227865-55fa-4aaa-a9f9-2b47803bcab5 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:27.824573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6c227865-55fa-4aaa-a9f9-2b47803bcab5 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:27.832510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c227865-55fa-4aaa-a9f9-2b47803bcab5 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:27.833013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c227865-55fa-4aaa-a9f9-2b47803bcab5 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:27.833832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c227865-55fa-4aaa-a9f9-2b47803bcab5 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:27.834342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c227865-55fa-4aaa-a9f9-2b47803bcab5 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:27.860923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2c706c7c-e13a-4551-8d45-a7c1ecebf9e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:27.861594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2c706c7c-e13a-4551-8d45-a7c1ecebf9e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:27.870398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c706c7c-e13a-4551-8d45-a7c1ecebf9e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:27.870904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c706c7c-e13a-4551-8d45-a7c1ecebf9e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:27.871836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c706c7c-e13a-4551-8d45-a7c1ecebf9e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:27.872328 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2c706c7c-e13a-4551-8d45-a7c1ecebf9e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:28.044561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6c227865-55fa-4aaa-a9f9-2b47803bcab5 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:28.054154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6c227865-55fa-4aaa-a9f9-2b47803bcab5 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.234316 Apr 19 03:45:28.054754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 490/958] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:27 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:28.084302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2c706c7c-e13a-4551-8d45-a7c1ecebf9e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:28.093297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2c706c7c-e13a-4551-8d45-a7c1ecebf9e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.236512 Apr 19 03:45:28.093910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 469/959] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:27 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:29.072761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a1576913-4d09-489f-ac0e-45d01a4e6516 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:29.073438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a1576913-4d09-489f-ac0e-45d01a4e6516 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:29.081734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1576913-4d09-489f-ac0e-45d01a4e6516 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:29.082242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1576913-4d09-489f-ac0e-45d01a4e6516 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:29.083070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1576913-4d09-489f-ac0e-45d01a4e6516 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:29.083588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1576913-4d09-489f-ac0e-45d01a4e6516 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:29.112653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a1b40c01-224a-4b72-a758-dab3cfca67bc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:29.113620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a1b40c01-224a-4b72-a758-dab3cfca67bc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:29.121980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1b40c01-224a-4b72-a758-dab3cfca67bc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:29.122539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1b40c01-224a-4b72-a758-dab3cfca67bc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:29.123428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1b40c01-224a-4b72-a758-dab3cfca67bc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:29.123930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1b40c01-224a-4b72-a758-dab3cfca67bc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:29.300189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a1576913-4d09-489f-ac0e-45d01a4e6516 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:29.309580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a1576913-4d09-489f-ac0e-45d01a4e6516 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.241496 Apr 19 03:45:29.310205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 491/960] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:29 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:29.340532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a1b40c01-224a-4b72-a758-dab3cfca67bc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:29.349565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a1b40c01-224a-4b72-a758-dab3cfca67bc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.241603 Apr 19 03:45:29.350183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 470/961] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:29 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:30.328454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bb5e67d2-59bb-4853-9293-3c89d7269db1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:30.329126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bb5e67d2-59bb-4853-9293-3c89d7269db1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:30.337970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb5e67d2-59bb-4853-9293-3c89d7269db1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:30.338476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb5e67d2-59bb-4853-9293-3c89d7269db1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:30.339360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb5e67d2-59bb-4853-9293-3c89d7269db1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:30.339852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb5e67d2-59bb-4853-9293-3c89d7269db1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:30.367354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-82f1e9c4-170c-43e8-bba3-3efaaf0bdee0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:30.368073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-82f1e9c4-170c-43e8-bba3-3efaaf0bdee0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:30.375916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82f1e9c4-170c-43e8-bba3-3efaaf0bdee0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:30.376430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82f1e9c4-170c-43e8-bba3-3efaaf0bdee0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:30.377261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82f1e9c4-170c-43e8-bba3-3efaaf0bdee0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:30.377749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82f1e9c4-170c-43e8-bba3-3efaaf0bdee0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:30.550701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bb5e67d2-59bb-4853-9293-3c89d7269db1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:30.560154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bb5e67d2-59bb-4853-9293-3c89d7269db1 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.235772 Apr 19 03:45:30.560760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 492/962] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:30 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:30.588574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-82f1e9c4-170c-43e8-bba3-3efaaf0bdee0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:30.597632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-82f1e9c4-170c-43e8-bba3-3efaaf0bdee0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.234666 Apr 19 03:45:30.598240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 471/963] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:30 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:31.578280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8cc5fa42-f4aa-4644-8d76-03904a577c1a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:31.578949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8cc5fa42-f4aa-4644-8d76-03904a577c1a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:31.586829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8cc5fa42-f4aa-4644-8d76-03904a577c1a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:31.587372 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8cc5fa42-f4aa-4644-8d76-03904a577c1a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:31.588206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8cc5fa42-f4aa-4644-8d76-03904a577c1a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:31.588705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8cc5fa42-f4aa-4644-8d76-03904a577c1a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:31.616657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f2ce4d07-7e41-4863-adc4-984714a5dd36 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:31.617472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f2ce4d07-7e41-4863-adc4-984714a5dd36 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:31.625933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2ce4d07-7e41-4863-adc4-984714a5dd36 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:31.626444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2ce4d07-7e41-4863-adc4-984714a5dd36 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:31.627355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2ce4d07-7e41-4863-adc4-984714a5dd36 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:31.627857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2ce4d07-7e41-4863-adc4-984714a5dd36 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:31.804950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8cc5fa42-f4aa-4644-8d76-03904a577c1a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:31.814234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8cc5fa42-f4aa-4644-8d76-03904a577c1a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.240141 Apr 19 03:45:31.814844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 493/964] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:31 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:31.846541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f2ce4d07-7e41-4863-adc4-984714a5dd36 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:31.855902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f2ce4d07-7e41-4863-adc4-984714a5dd36 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.244093 Apr 19 03:45:31.856524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 472/965] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:31 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:32.832267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-021cfe6e-8dc3-4beb-a3cd-093e78efeed6 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:32.832950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-021cfe6e-8dc3-4beb-a3cd-093e78efeed6 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:32.840966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-021cfe6e-8dc3-4beb-a3cd-093e78efeed6 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:32.841476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-021cfe6e-8dc3-4beb-a3cd-093e78efeed6 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:32.842308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-021cfe6e-8dc3-4beb-a3cd-093e78efeed6 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:32.842806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-021cfe6e-8dc3-4beb-a3cd-093e78efeed6 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:32.874684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-adb0c953-cddf-46d6-8839-c87b1f441806 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:32.875421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-adb0c953-cddf-46d6-8839-c87b1f441806 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:32.883928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adb0c953-cddf-46d6-8839-c87b1f441806 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:32.884433 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adb0c953-cddf-46d6-8839-c87b1f441806 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:32.885257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adb0c953-cddf-46d6-8839-c87b1f441806 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:32.885743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adb0c953-cddf-46d6-8839-c87b1f441806 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:33.067907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-021cfe6e-8dc3-4beb-a3cd-093e78efeed6 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:33.078150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-021cfe6e-8dc3-4beb-a3cd-093e78efeed6 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.249850 Apr 19 03:45:33.079089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 494/966] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:32 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:33.113688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-adb0c953-cddf-46d6-8839-c87b1f441806 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:33.123248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-adb0c953-cddf-46d6-8839-c87b1f441806 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.252558 Apr 19 03:45:33.123862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 473/967] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:32 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:33.268486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-fd57c715-9e59-4c0e-8584-c44f504c9a4d req-20f3a538-74b8-40d1-9ca5-54a986b7138c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc5cf11-07e5-4749-b662-5d41fef38609", "name": "network-vif-unplugged", "status": "completed", "tag": "fbdc9349-8214-499d-88ec-f32902245c65"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:33.270282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:45:33.270282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:45:33.279386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-fd57c715-9e59-4c0e-8584-c44f504c9a4d req-20f3a538-74b8-40d1-9ca5-54a986b7138c service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:33.279886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-fd57c715-9e59-4c0e-8584-c44f504c9a4d req-20f3a538-74b8-40d1-9ca5-54a986b7138c service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:33.298684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-fd57c715-9e59-4c0e-8584-c44f504c9a4d req-20f3a538-74b8-40d1-9ca5-54a986b7138c service nova] Creating event network-vif-unplugged:fbdc9349-8214-499d-88ec-f32902245c65 for instance 3cc5cf11-07e5-4749-b662-5d41fef38609 on hv-cinder-78605 Apr 19 03:45:33.304510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-fd57c715-9e59-4c0e-8584-c44f504c9a4d req-20f3a538-74b8-40d1-9ca5-54a986b7138c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039985 Apr 19 03:45:33.305206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 495/968] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:45:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:45:34.103013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c2da17cc-cffc-4c64-bab4-7f7e326ec406 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:34.103013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c2da17cc-cffc-4c64-bab4-7f7e326ec406 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:34.104848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2da17cc-cffc-4c64-bab4-7f7e326ec406 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:34.105359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2da17cc-cffc-4c64-bab4-7f7e326ec406 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:34.106196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2da17cc-cffc-4c64-bab4-7f7e326ec406 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:34.106686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2da17cc-cffc-4c64-bab4-7f7e326ec406 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:34.142936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bd30fc3c-47de-4612-b6a1-6df2d7f6b631 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:34.143840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bd30fc3c-47de-4612-b6a1-6df2d7f6b631 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:34.152883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd30fc3c-47de-4612-b6a1-6df2d7f6b631 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:34.153523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd30fc3c-47de-4612-b6a1-6df2d7f6b631 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:34.154435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd30fc3c-47de-4612-b6a1-6df2d7f6b631 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:34.155020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd30fc3c-47de-4612-b6a1-6df2d7f6b631 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:34.317312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c2da17cc-cffc-4c64-bab4-7f7e326ec406 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:34.327088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c2da17cc-cffc-4c64-bab4-7f7e326ec406 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.234767 Apr 19 03:45:34.327813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 474/969] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:34 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:34.369400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bd30fc3c-47de-4612-b6a1-6df2d7f6b631 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:34.378565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bd30fc3c-47de-4612-b6a1-6df2d7f6b631 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.240320 Apr 19 03:45:34.379209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 496/970] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:34 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:35.345277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4aeab3f6-8053-46ca-afdc-af4d09470057 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:35.345948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4aeab3f6-8053-46ca-afdc-af4d09470057 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:35.354444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4aeab3f6-8053-46ca-afdc-af4d09470057 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:35.354947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4aeab3f6-8053-46ca-afdc-af4d09470057 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:35.355807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4aeab3f6-8053-46ca-afdc-af4d09470057 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:35.356296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4aeab3f6-8053-46ca-afdc-af4d09470057 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:35.397955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c1025a2a-9560-4837-8b16-f94cfb445dc8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:35.398560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c1025a2a-9560-4837-8b16-f94cfb445dc8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:35.406240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1025a2a-9560-4837-8b16-f94cfb445dc8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:35.406739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1025a2a-9560-4837-8b16-f94cfb445dc8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:35.407563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1025a2a-9560-4837-8b16-f94cfb445dc8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:35.408052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1025a2a-9560-4837-8b16-f94cfb445dc8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:35.570526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4aeab3f6-8053-46ca-afdc-af4d09470057 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:35.579984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4aeab3f6-8053-46ca-afdc-af4d09470057 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.238831 Apr 19 03:45:35.580797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 475/971] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:35 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:35.628443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c1025a2a-9560-4837-8b16-f94cfb445dc8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:35.637793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c1025a2a-9560-4837-8b16-f94cfb445dc8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.244535 Apr 19 03:45:35.638415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 497/972] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:35 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:36.598825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d01ff18d-c093-4e7a-9e74-5cc229c89064 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:36.600233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d01ff18d-c093-4e7a-9e74-5cc229c89064 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:36.608105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d01ff18d-c093-4e7a-9e74-5cc229c89064 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:36.608609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d01ff18d-c093-4e7a-9e74-5cc229c89064 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:36.609438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d01ff18d-c093-4e7a-9e74-5cc229c89064 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:36.609927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d01ff18d-c093-4e7a-9e74-5cc229c89064 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:36.657026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9d6a79a6-eba0-49d8-926a-161ebf08bff8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:36.657858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9d6a79a6-eba0-49d8-926a-161ebf08bff8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:36.666417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d6a79a6-eba0-49d8-926a-161ebf08bff8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:36.667017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d6a79a6-eba0-49d8-926a-161ebf08bff8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:36.667875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d6a79a6-eba0-49d8-926a-161ebf08bff8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:36.668368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d6a79a6-eba0-49d8-926a-161ebf08bff8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:36.827368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d01ff18d-c093-4e7a-9e74-5cc229c89064 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:36.837268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d01ff18d-c093-4e7a-9e74-5cc229c89064 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.242572 Apr 19 03:45:36.837892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 476/973] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:36 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:36.878087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9d6a79a6-eba0-49d8-926a-161ebf08bff8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:36.887566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9d6a79a6-eba0-49d8-926a-161ebf08bff8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.234639 Apr 19 03:45:36.888181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 498/974] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:36 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:37.855882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2622fb28-f820-40b9-84a6-28b88ad024a0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:37.856563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2622fb28-f820-40b9-84a6-28b88ad024a0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:37.864841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2622fb28-f820-40b9-84a6-28b88ad024a0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:37.865353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2622fb28-f820-40b9-84a6-28b88ad024a0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:37.866897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2622fb28-f820-40b9-84a6-28b88ad024a0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:37.867443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2622fb28-f820-40b9-84a6-28b88ad024a0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:37.906224 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-012fb932-6a48-4163-b767-d7e7b9d6600c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:37.906899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-012fb932-6a48-4163-b767-d7e7b9d6600c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:37.914697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-012fb932-6a48-4163-b767-d7e7b9d6600c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:37.931633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-012fb932-6a48-4163-b767-d7e7b9d6600c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:37.932747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-012fb932-6a48-4163-b767-d7e7b9d6600c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:37.933265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-012fb932-6a48-4163-b767-d7e7b9d6600c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:38.087879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2622fb28-f820-40b9-84a6-28b88ad024a0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:38.096914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2622fb28-f820-40b9-84a6-28b88ad024a0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1576 microversion: 2.1 time: 0.245272 Apr 19 03:45:38.107261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 477/975] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:37 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:38.371853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-012fb932-6a48-4163-b767-d7e7b9d6600c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:38.381806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-012fb932-6a48-4163-b767-d7e7b9d6600c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.479746 Apr 19 03:45:38.382626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 499/976] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:37 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:38.520361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-629a3c08-88a4-4376-8dfe-203d3199fd2b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:38.521491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-629a3c08-88a4-4376-8dfe-203d3199fd2b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:38.531363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-629a3c08-88a4-4376-8dfe-203d3199fd2b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:38.532008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-629a3c08-88a4-4376-8dfe-203d3199fd2b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:38.532989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-629a3c08-88a4-4376-8dfe-203d3199fd2b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:38.533573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-629a3c08-88a4-4376-8dfe-203d3199fd2b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:38.625743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-629a3c08-88a4-4376-8dfe-203d3199fd2b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.109515 Apr 19 03:45:38.626349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 478/977] 10.222.0.25 () {58 vars in 1292 bytes} [Mon Apr 19 03:45:38 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:45:38.871979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-467a8d95-bc02-41fa-ac59-97a93c884ddf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:38.872516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-467a8d95-bc02-41fa-ac59-97a93c884ddf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:38.880403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-467a8d95-bc02-41fa-ac59-97a93c884ddf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:38.880864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-467a8d95-bc02-41fa-ac59-97a93c884ddf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:38.881698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-467a8d95-bc02-41fa-ac59-97a93c884ddf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:38.882194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-467a8d95-bc02-41fa-ac59-97a93c884ddf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:38.957682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-467a8d95-bc02-41fa-ac59-97a93c884ddf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/ea016622-7478-41dc-b517-a7a657ca032b" status: 200 len: 194 microversion: 2.1 time: 0.090034 Apr 19 03:45:38.958372 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 500/978] 10.222.0.25 () {58 vars in 1403 bytes} [Mon Apr 19 03:45:38 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/ea016622-7478-41dc-b517-a7a657ca032b => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:45:38.969133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8df24ee1-595e-4b32-adcd-99550d022bf9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:38.969981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8df24ee1-595e-4b32-adcd-99550d022bf9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:38.979031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8df24ee1-595e-4b32-adcd-99550d022bf9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:38.981248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8df24ee1-595e-4b32-adcd-99550d022bf9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:38.982292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8df24ee1-595e-4b32-adcd-99550d022bf9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:38.982939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8df24ee1-595e-4b32-adcd-99550d022bf9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:39.028870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-142ea251-2810-4ee9-8554-8a2c924c9cef req-ff7f0589-c83b-4478-88a6-c332ce09bf54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e2695b-dd12-444c-8d09-a65518f70b76", "name": "network-vif-deleted", "tag": "cdee7d9f-4c20-4572-8d6d-32ffe46d4cfe"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:39.030845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:45:39.030845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:45:39.047056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-142ea251-2810-4ee9-8554-8a2c924c9cef req-ff7f0589-c83b-4478-88a6-c332ce09bf54 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:39.047579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-142ea251-2810-4ee9-8554-8a2c924c9cef req-ff7f0589-c83b-4478-88a6-c332ce09bf54 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:39.069973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-142ea251-2810-4ee9-8554-8a2c924c9cef req-ff7f0589-c83b-4478-88a6-c332ce09bf54 service nova] Creating event network-vif-deleted:cdee7d9f-4c20-4572-8d6d-32ffe46d4cfe for instance b1e2695b-dd12-444c-8d09-a65518f70b76 on hv-cinder-78605 Apr 19 03:45:39.075430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-142ea251-2810-4ee9-8554-8a2c924c9cef req-ff7f0589-c83b-4478-88a6-c332ce09bf54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050567 Apr 19 03:45:39.076338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 501/979] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:45:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:45:39.115119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3b71592f-e262-4dd8-834b-bf7d4200078a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:39.115942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3b71592f-e262-4dd8-834b-bf7d4200078a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:39.124359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b71592f-e262-4dd8-834b-bf7d4200078a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:39.124870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b71592f-e262-4dd8-834b-bf7d4200078a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:39.125687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b71592f-e262-4dd8-834b-bf7d4200078a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:39.126363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b71592f-e262-4dd8-834b-bf7d4200078a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:39.182246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-8df24ee1-595e-4b32-adcd-99550d022bf9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lazy-loading 'services' on Instance uuid 0656c7c5-439a-47a8-ab73-8a5e4e007bbd {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:45:39.304411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3b71592f-e262-4dd8-834b-bf7d4200078a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:39.313460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3b71592f-e262-4dd8-834b-bf7d4200078a tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.203188 Apr 19 03:45:39.314086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 502/980] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:39 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:39.400688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f5b50e63-1786-477d-8c88-3f6196482b0b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:39.401291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f5b50e63-1786-477d-8c88-3f6196482b0b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:39.409374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5b50e63-1786-477d-8c88-3f6196482b0b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:39.409879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5b50e63-1786-477d-8c88-3f6196482b0b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:39.410706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5b50e63-1786-477d-8c88-3f6196482b0b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:39.411220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5b50e63-1786-477d-8c88-3f6196482b0b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:39.622708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f5b50e63-1786-477d-8c88-3f6196482b0b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:39.632543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f5b50e63-1786-477d-8c88-3f6196482b0b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.236582 Apr 19 03:45:39.633178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 503/981] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:39 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:40.332036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-01f6df7d-953b-43ac-b291-b10f8bd55748 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:40.332707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-01f6df7d-953b-43ac-b291-b10f8bd55748 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:40.341131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01f6df7d-953b-43ac-b291-b10f8bd55748 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:40.341640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01f6df7d-953b-43ac-b291-b10f8bd55748 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:40.342470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01f6df7d-953b-43ac-b291-b10f8bd55748 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:40.342955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01f6df7d-953b-43ac-b291-b10f8bd55748 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:40.471563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-01f6df7d-953b-43ac-b291-b10f8bd55748 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:40.481378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-01f6df7d-953b-43ac-b291-b10f8bd55748 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.153917 Apr 19 03:45:40.481997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 504/982] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:40 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:40.651423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2dedf510-4556-43aa-bf30-48ad2a46d99a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:40.652097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2dedf510-4556-43aa-bf30-48ad2a46d99a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:40.660456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dedf510-4556-43aa-bf30-48ad2a46d99a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:40.660960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dedf510-4556-43aa-bf30-48ad2a46d99a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:40.661795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dedf510-4556-43aa-bf30-48ad2a46d99a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:40.662283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2dedf510-4556-43aa-bf30-48ad2a46d99a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:40.869818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2dedf510-4556-43aa-bf30-48ad2a46d99a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:40.878697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2dedf510-4556-43aa-bf30-48ad2a46d99a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.231510 Apr 19 03:45:40.879343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 505/983] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:40 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:41.498191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8de6f915-9c70-4e11-9eac-df713486ecd0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:41.498857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8de6f915-9c70-4e11-9eac-df713486ecd0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:41.506847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8de6f915-9c70-4e11-9eac-df713486ecd0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:41.507404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8de6f915-9c70-4e11-9eac-df713486ecd0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:41.508225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8de6f915-9c70-4e11-9eac-df713486ecd0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:41.508707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8de6f915-9c70-4e11-9eac-df713486ecd0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:41.634681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8de6f915-9c70-4e11-9eac-df713486ecd0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:41.643599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8de6f915-9c70-4e11-9eac-df713486ecd0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.149359 Apr 19 03:45:41.644228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 506/984] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:41 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:41.897267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5ad4dffe-bf7c-466c-8f50-05ea4eb1762d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:41.897882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5ad4dffe-bf7c-466c-8f50-05ea4eb1762d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:41.905604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ad4dffe-bf7c-466c-8f50-05ea4eb1762d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:41.906125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ad4dffe-bf7c-466c-8f50-05ea4eb1762d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:41.906958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ad4dffe-bf7c-466c-8f50-05ea4eb1762d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:41.907482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ad4dffe-bf7c-466c-8f50-05ea4eb1762d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:42.117495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5ad4dffe-bf7c-466c-8f50-05ea4eb1762d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:42.126458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5ad4dffe-bf7c-466c-8f50-05ea4eb1762d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.233660 Apr 19 03:45:42.127074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 507/985] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:41 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:42.661432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4a77527a-882c-4096-ad12-863de4a617c4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:42.662052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4a77527a-882c-4096-ad12-863de4a617c4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:42.669851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a77527a-882c-4096-ad12-863de4a617c4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:42.670360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a77527a-882c-4096-ad12-863de4a617c4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:42.671209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a77527a-882c-4096-ad12-863de4a617c4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:42.671700 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a77527a-882c-4096-ad12-863de4a617c4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:42.793165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4a77527a-882c-4096-ad12-863de4a617c4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:42.802656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4a77527a-882c-4096-ad12-863de4a617c4 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.144882 Apr 19 03:45:42.803283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 508/986] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:42 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:43.144096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-da01b073-a652-4609-ba71-50d7de660107 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:43.144768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-da01b073-a652-4609-ba71-50d7de660107 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:43.152503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da01b073-a652-4609-ba71-50d7de660107 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:43.153011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da01b073-a652-4609-ba71-50d7de660107 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:43.153843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da01b073-a652-4609-ba71-50d7de660107 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:43.154329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da01b073-a652-4609-ba71-50d7de660107 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:43.368588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-da01b073-a652-4609-ba71-50d7de660107 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:43.377482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-da01b073-a652-4609-ba71-50d7de660107 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.237299 Apr 19 03:45:43.378103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 509/987] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:43 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:43.820888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9cfbb863-21b4-4105-8cbf-afd894bfc982 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:43.821554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9cfbb863-21b4-4105-8cbf-afd894bfc982 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:43.829404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9cfbb863-21b4-4105-8cbf-afd894bfc982 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:43.829886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9cfbb863-21b4-4105-8cbf-afd894bfc982 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:43.830715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9cfbb863-21b4-4105-8cbf-afd894bfc982 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:43.831231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9cfbb863-21b4-4105-8cbf-afd894bfc982 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:43.955323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9cfbb863-21b4-4105-8cbf-afd894bfc982 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:43.964803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9cfbb863-21b4-4105-8cbf-afd894bfc982 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.148538 Apr 19 03:45:43.965444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 510/988] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:43 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:44.395916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c26cfd2e-0b9a-46b2-88fc-395303f1a3ff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:44.396500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c26cfd2e-0b9a-46b2-88fc-395303f1a3ff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:44.404315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c26cfd2e-0b9a-46b2-88fc-395303f1a3ff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:44.404815 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c26cfd2e-0b9a-46b2-88fc-395303f1a3ff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:44.405634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c26cfd2e-0b9a-46b2-88fc-395303f1a3ff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:44.406116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c26cfd2e-0b9a-46b2-88fc-395303f1a3ff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:44.618856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c26cfd2e-0b9a-46b2-88fc-395303f1a3ff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:44.627764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c26cfd2e-0b9a-46b2-88fc-395303f1a3ff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.235990 Apr 19 03:45:44.628378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 511/989] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:44 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:44.982154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8c0237db-dc6d-4ad9-a997-b7105227acac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:44.982815 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8c0237db-dc6d-4ad9-a997-b7105227acac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:44.990785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8c0237db-dc6d-4ad9-a997-b7105227acac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:44.991317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8c0237db-dc6d-4ad9-a997-b7105227acac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:44.992141 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8c0237db-dc6d-4ad9-a997-b7105227acac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:44.992627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8c0237db-dc6d-4ad9-a997-b7105227acac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:45.112726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8c0237db-dc6d-4ad9-a997-b7105227acac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:45.121647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8c0237db-dc6d-4ad9-a997-b7105227acac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.143390 Apr 19 03:45:45.122267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 512/990] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:44 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:45.645899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3302333c-111e-4bcc-a91d-02cc3c1d0a94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:45.646563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3302333c-111e-4bcc-a91d-02cc3c1d0a94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:45.654311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3302333c-111e-4bcc-a91d-02cc3c1d0a94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:45.654810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3302333c-111e-4bcc-a91d-02cc3c1d0a94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:45.655655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3302333c-111e-4bcc-a91d-02cc3c1d0a94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:45.656140 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3302333c-111e-4bcc-a91d-02cc3c1d0a94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:45.869060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3302333c-111e-4bcc-a91d-02cc3c1d0a94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:45.877719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3302333c-111e-4bcc-a91d-02cc3c1d0a94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.235905 Apr 19 03:45:45.878337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 513/991] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:45 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:46.139704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-21f1f359-fa50-4edd-9e3e-1e2104e597d0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:46.140431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-21f1f359-fa50-4edd-9e3e-1e2104e597d0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:46.148075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21f1f359-fa50-4edd-9e3e-1e2104e597d0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:46.148580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21f1f359-fa50-4edd-9e3e-1e2104e597d0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:46.149396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21f1f359-fa50-4edd-9e3e-1e2104e597d0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:46.149899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21f1f359-fa50-4edd-9e3e-1e2104e597d0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:46.271644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-21f1f359-fa50-4edd-9e3e-1e2104e597d0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:46.280900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-21f1f359-fa50-4edd-9e3e-1e2104e597d0 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.145298 Apr 19 03:45:46.281518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 514/992] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:46 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:46.897374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f2248864-c24f-4131-9f72-9514e620900b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:46.898082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f2248864-c24f-4131-9f72-9514e620900b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:46.906023 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2248864-c24f-4131-9f72-9514e620900b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:46.906524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2248864-c24f-4131-9f72-9514e620900b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:46.907370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2248864-c24f-4131-9f72-9514e620900b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:46.907859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2248864-c24f-4131-9f72-9514e620900b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:47.117811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f2248864-c24f-4131-9f72-9514e620900b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:47.126701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f2248864-c24f-4131-9f72-9514e620900b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.234201 Apr 19 03:45:47.127353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 515/993] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:46 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:47.297936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-781565be-de21-4048-bdb6-47f6835835ac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:47.298613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-781565be-de21-4048-bdb6-47f6835835ac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:47.306942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-781565be-de21-4048-bdb6-47f6835835ac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:47.307482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-781565be-de21-4048-bdb6-47f6835835ac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:47.308317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-781565be-de21-4048-bdb6-47f6835835ac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:47.308812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-781565be-de21-4048-bdb6-47f6835835ac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:47.435287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-781565be-de21-4048-bdb6-47f6835835ac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:47.444188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-781565be-de21-4048-bdb6-47f6835835ac tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.150259 Apr 19 03:45:47.444807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 516/994] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:47 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:48.145696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6152ed0c-73ae-4024-a1d4-218defd28d2f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:48.146892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6152ed0c-73ae-4024-a1d4-218defd28d2f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:48.154708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6152ed0c-73ae-4024-a1d4-218defd28d2f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:48.155240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6152ed0c-73ae-4024-a1d4-218defd28d2f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:48.156069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6152ed0c-73ae-4024-a1d4-218defd28d2f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:48.156557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6152ed0c-73ae-4024-a1d4-218defd28d2f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:48.370048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6152ed0c-73ae-4024-a1d4-218defd28d2f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:48.378872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6152ed0c-73ae-4024-a1d4-218defd28d2f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.237417 Apr 19 03:45:48.379512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 517/995] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:48 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:48.384792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-63cc09ec-698d-43e1-91a5-f12dbd274337 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-127193136"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:48.385373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-63cc09ec-698d-43e1-91a5-f12dbd274337 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:48.392679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-63cc09ec-698d-43e1-91a5-f12dbd274337 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:48.393181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-63cc09ec-698d-43e1-91a5-f12dbd274337 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:48.394002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-63cc09ec-698d-43e1-91a5-f12dbd274337 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:48.394489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-63cc09ec-698d-43e1-91a5-f12dbd274337 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:48.599242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.network.security_group_api [None req-63cc09ec-698d-43e1-91a5-f12dbd274337 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Removing security group 66b36786-e00e-4b37-85ae-56630e0a8890 from port 589d1f32-cd4b-4443-9982-41cdb9265434 Apr 19 03:45:49.121436 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-63cc09ec-698d-43e1-91a5-f12dbd274337 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "POST /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/action" status: 202 len: 0 microversion: 2.1 time: 0.740242 Apr 19 03:45:49.122160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 518/996] 10.222.0.25 () {60 vars in 1268 bytes} [Mon Apr 19 03:45:48 2021] POST /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:45:49.129402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f21d316d-57fb-4cb3-bed1-7b72088d029b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:49.130602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f21d316d-57fb-4cb3-bed1-7b72088d029b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:49.140114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f21d316d-57fb-4cb3-bed1-7b72088d029b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:49.140626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f21d316d-57fb-4cb3-bed1-7b72088d029b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:49.141486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f21d316d-57fb-4cb3-bed1-7b72088d029b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:49.142117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f21d316d-57fb-4cb3-bed1-7b72088d029b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:49.277175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f21d316d-57fb-4cb3-bed1-7b72088d029b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:49.287254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f21d316d-57fb-4cb3-bed1-7b72088d029b tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.163256 Apr 19 03:45:49.297489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 519/997] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:49 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:49.303003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-bbf87950-79d7-4788-811b-9aa11376e0e2 req-9d4b444c-8b73-45c0-9a5c-3ac5a4cc820d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eebf65c-de9c-4548-aab3-63d7c52a229c", "tag": "589d1f32-cd4b-4443-9982-41cdb9265434"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:45:49.304913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:45:49.304913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:45:49.314407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-bbf87950-79d7-4788-811b-9aa11376e0e2 req-9d4b444c-8b73-45c0-9a5c-3ac5a4cc820d service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:49.314907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-bbf87950-79d7-4788-811b-9aa11376e0e2 req-9d4b444c-8b73-45c0-9a5c-3ac5a4cc820d service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:49.338739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-bbf87950-79d7-4788-811b-9aa11376e0e2 req-9d4b444c-8b73-45c0-9a5c-3ac5a4cc820d service nova] Creating event network-changed:589d1f32-cd4b-4443-9982-41cdb9265434 for instance 0eebf65c-de9c-4548-aab3-63d7c52a229c on hv-cinder-78605 Apr 19 03:45:49.344350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-bbf87950-79d7-4788-811b-9aa11376e0e2 req-9d4b444c-8b73-45c0-9a5c-3ac5a4cc820d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045353 Apr 19 03:45:49.345025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 520/998] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:45:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:45:49.398799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-13b19ec7-43cf-41fb-b724-b5a5836e57d1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:49.399671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-13b19ec7-43cf-41fb-b724-b5a5836e57d1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:49.408279 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13b19ec7-43cf-41fb-b724-b5a5836e57d1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:49.408686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13b19ec7-43cf-41fb-b724-b5a5836e57d1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:49.409685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13b19ec7-43cf-41fb-b724-b5a5836e57d1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:49.410174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13b19ec7-43cf-41fb-b724-b5a5836e57d1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:50.072481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-13b19ec7-43cf-41fb-b724-b5a5836e57d1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:50.082399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-13b19ec7-43cf-41fb-b724-b5a5836e57d1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.688896 Apr 19 03:45:50.091598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 521/999] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:49 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:50.305768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4a104a5b-f4d6-474f-9635-0b9f00442484 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:50.306445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4a104a5b-f4d6-474f-9635-0b9f00442484 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:50.314719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a104a5b-f4d6-474f-9635-0b9f00442484 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:50.315284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a104a5b-f4d6-474f-9635-0b9f00442484 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:50.316141 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a104a5b-f4d6-474f-9635-0b9f00442484 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:50.316635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a104a5b-f4d6-474f-9635-0b9f00442484 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:50.448766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4a104a5b-f4d6-474f-9635-0b9f00442484 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:50.457764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4a104a5b-f4d6-474f-9635-0b9f00442484 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.156698 Apr 19 03:45:50.458437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 522/1000] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:50 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:45:51.102399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a4b7afc9-978b-4827-abfb-c8b89787a9e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:51.103070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a4b7afc9-978b-4827-abfb-c8b89787a9e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:51.110946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4b7afc9-978b-4827-abfb-c8b89787a9e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:51.111505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4b7afc9-978b-4827-abfb-c8b89787a9e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:51.112338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4b7afc9-978b-4827-abfb-c8b89787a9e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:51.112831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4b7afc9-978b-4827-abfb-c8b89787a9e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:51.339531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a4b7afc9-978b-4827-abfb-c8b89787a9e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:45:51.348579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a4b7afc9-978b-4827-abfb-c8b89787a9e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.251026 Apr 19 03:45:51.349265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 523/1001] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:45:51 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:45:51.354297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-82a41017-a55c-4437-862c-a97470fe3727 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:45:51.354851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-82a41017-a55c-4437-862c-a97470fe3727 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:45:51.362640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82a41017-a55c-4437-862c-a97470fe3727 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:51.363431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82a41017-a55c-4437-862c-a97470fe3727 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:45:51.364323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82a41017-a55c-4437-862c-a97470fe3727 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:45:51.364817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82a41017-a55c-4437-862c-a97470fe3727 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:46:43.173196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:46:43.173725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:46:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/os-volume_attachments/5699cd4c-a391-49a6-85cd-09fde627babe (ip 10.222.0.25) !!! Apr 19 03:47:37.640485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8df24ee1-595e-4b32-adcd-99550d022bf9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [e967043d-a773-45ac-9a41-ad4d77f889e0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 19 03:47:37.810883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-82a41017-a55c-4437-862c-a97470fe3727 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lazy-loading 'services' on Instance uuid 0eebf65c-de9c-4548-aab3-63d7c52a229c {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:47:38.058053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-82a41017-a55c-4437-862c-a97470fe3727 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/os-volume_attachments/5699cd4c-a391-49a6-85cd-09fde627babe" status: 202 len: 0 microversion: 2.1 time: 106.707349 Apr 19 03:47:38.058605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 524/1002] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:45:51 2021] DELETE /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/os-volume_attachments/5699cd4c-a391-49a6-85cd-09fde627babe => generated 0 bytes in 106709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:47:38.065094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-099220b8-d9a7-4482-9bed-541462fcdb6d req-0e5a4424-d6ce-4c20-8c89-923b8963a603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eebf65c-de9c-4548-aab3-63d7c52a229c", "tag": "589d1f32-cd4b-4443-9982-41cdb9265434"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:47:38.067393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:47:38.067393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:47:38.077006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-099220b8-d9a7-4482-9bed-541462fcdb6d req-0e5a4424-d6ce-4c20-8c89-923b8963a603 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:38.077506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-099220b8-d9a7-4482-9bed-541462fcdb6d req-0e5a4424-d6ce-4c20-8c89-923b8963a603 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:38.095564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-099220b8-d9a7-4482-9bed-541462fcdb6d req-0e5a4424-d6ce-4c20-8c89-923b8963a603 service nova] Creating event network-changed:589d1f32-cd4b-4443-9982-41cdb9265434 for instance 0eebf65c-de9c-4548-aab3-63d7c52a229c on hv-cinder-78605 Apr 19 03:47:38.100529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-099220b8-d9a7-4482-9bed-541462fcdb6d req-0e5a4424-d6ce-4c20-8c89-923b8963a603 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040521 Apr 19 03:47:38.101158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 525/1003] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:47:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:47:38.226886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ce0d2d56-5afb-4f56-8e72-181386a30289 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:38.227693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ce0d2d56-5afb-4f56-8e72-181386a30289 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:38.236402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce0d2d56-5afb-4f56-8e72-181386a30289 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:38.236836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce0d2d56-5afb-4f56-8e72-181386a30289 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:38.237595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce0d2d56-5afb-4f56-8e72-181386a30289 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:38.238078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce0d2d56-5afb-4f56-8e72-181386a30289 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:38.384833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ce0d2d56-5afb-4f56-8e72-181386a30289 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:38.393590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ce0d2d56-5afb-4f56-8e72-181386a30289 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1224 microversion: 2.1 time: 0.291262 Apr 19 03:47:38.394208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 526/1004] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:38 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1224 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:38.511932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7cc52c56-298a-4dff-bbaa-0f16cfaaa2ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:38.512597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7cc52c56-298a-4dff-bbaa-0f16cfaaa2ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:38.520393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cc52c56-298a-4dff-bbaa-0f16cfaaa2ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:38.520892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cc52c56-298a-4dff-bbaa-0f16cfaaa2ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:38.521708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cc52c56-298a-4dff-bbaa-0f16cfaaa2ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:38.522193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7cc52c56-298a-4dff-bbaa-0f16cfaaa2ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:38.657846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [None req-8df24ee1-595e-4b32-adcd-99550d022bf9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [e967043d-a773-45ac-9a41-ad4d77f889e0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38274. Apr 19 03:47:38.662500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8df24ee1-595e-4b32-adcd-99550d022bf9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/ea016622-7478-41dc-b517-a7a657ca032b" status: 202 len: 0 microversion: 2.1 time: 119.697498 Apr 19 03:47:38.663804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 479/1005] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:45:38 2021] DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/ea016622-7478-41dc-b517-a7a657ca032b => generated 0 bytes in 119700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:47:38.669976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4919493d-fc5a-4f84-9715-ae2a2fa4d6a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:38.671305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4919493d-fc5a-4f84-9715-ae2a2fa4d6a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:38.681194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4919493d-fc5a-4f84-9715-ae2a2fa4d6a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:38.681966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4919493d-fc5a-4f84-9715-ae2a2fa4d6a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:38.683308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4919493d-fc5a-4f84-9715-ae2a2fa4d6a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:38.684033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4919493d-fc5a-4f84-9715-ae2a2fa4d6a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.050230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7cc52c56-298a-4dff-bbaa-0f16cfaaa2ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:39.059773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7cc52c56-298a-4dff-bbaa-0f16cfaaa2ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.664537 Apr 19 03:47:39.060397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 527/1006] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:38 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:39.065185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3fd19227-5008-47d5-ade1-5b3c2b5c38fd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:39.065722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3fd19227-5008-47d5-ade1-5b3c2b5c38fd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:39.073155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd19227-5008-47d5-ade1-5b3c2b5c38fd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.073662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd19227-5008-47d5-ade1-5b3c2b5c38fd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.074487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd19227-5008-47d5-ade1-5b3c2b5c38fd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.074975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd19227-5008-47d5-ade1-5b3c2b5c38fd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.384997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-4919493d-fc5a-4f84-9715-ae2a2fa4d6a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lazy-loading 'services' on Instance uuid 0656c7c5-439a-47a8-ab73-8a5e4e007bbd {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:47:39.597950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-3fd19227-5008-47d5-ade1-5b3c2b5c38fd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lazy-loading 'services' on Instance uuid 0eebf65c-de9c-4548-aab3-63d7c52a229c {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:47:39.653388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-4919493d-fc5a-4f84-9715-ae2a2fa4d6a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3cf08618-86f0-4925-b327-36218f16b39e) Apr 19 03:47:39.654154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4919493d-fc5a-4f84-9715-ae2a2fa4d6a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3cf08618-86f0-4925-b327-36218f16b39e) {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:47:39.655187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4919493d-fc5a-4f84-9715-ae2a2fa4d6a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/ea016622-7478-41dc-b517-a7a657ca032b" status: 400 len: 269 microversion: 2.1 time: 0.989900 Apr 19 03:47:39.655962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 480/1007] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:47:38 2021] DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/ea016622-7478-41dc-b517-a7a657ca032b => generated 269 bytes in 991 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 03:47:39.661089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:39.662001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:39.669988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.670498 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.671375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.671872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.732110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-3fd19227-5008-47d5-ade1-5b3c2b5c38fd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-828407a5-022d-42bc-bf4f-25a9b60a8d48) Apr 19 03:47:39.732873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3fd19227-5008-47d5-ade1-5b3c2b5c38fd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-828407a5-022d-42bc-bf4f-25a9b60a8d48) {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:47:39.733860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3fd19227-5008-47d5-ade1-5b3c2b5c38fd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/os-volume_attachments/5699cd4c-a391-49a6-85cd-09fde627babe" status: 400 len: 269 microversion: 2.1 time: 0.672482 Apr 19 03:47:39.734557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 528/1008] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:47:39 2021] DELETE /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/os-volume_attachments/5699cd4c-a391-49a6-85cd-09fde627babe => generated 269 bytes in 674 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 03:47:39.742430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6b402710-227f-4ced-a4e7-3718e5b3225f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:39.743106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6b402710-227f-4ced-a4e7-3718e5b3225f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:39.751413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b402710-227f-4ced-a4e7-3718e5b3225f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.755298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b402710-227f-4ced-a4e7-3718e5b3225f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.755298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b402710-227f-4ced-a4e7-3718e5b3225f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.755298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b402710-227f-4ced-a4e7-3718e5b3225f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.775448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.776070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.776679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lazy-loading 'fault' on Instance uuid b1e2695b-dd12-444c-8d09-a65518f70b76 {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:47:39.842170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8af417bbfa4deda2c64b88a8d5c6ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a012a767fda74dde8c60610167f3a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:39.851353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8f6f86e5-5046-4678-884e-1a855b7a21c3 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 200 len: 1229 microversion: 2.1 time: 0.194282 Apr 19 03:47:39.851775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 481/1009] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:39 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 1229 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:39.856832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-64732c9f-97e5-4d9b-ba44-11b597634146 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:39.857513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-64732c9f-97e5-4d9b-ba44-11b597634146 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:39.866180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64732c9f-97e5-4d9b-ba44-11b597634146 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.866888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64732c9f-97e5-4d9b-ba44-11b597634146 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.867944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64732c9f-97e5-4d9b-ba44-11b597634146 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.868446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64732c9f-97e5-4d9b-ba44-11b597634146 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.974388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6b402710-227f-4ced-a4e7-3718e5b3225f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:39.983418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6b402710-227f-4ced-a4e7-3718e5b3225f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.247633 Apr 19 03:47:39.989949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 529/1010] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:39 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:39.989949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-68d6cada-4353-4693-8e05-c97b048d3154 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:39.990157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-68d6cada-4353-4693-8e05-c97b048d3154 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:39.997726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68d6cada-4353-4693-8e05-c97b048d3154 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.998235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68d6cada-4353-4693-8e05-c97b048d3154 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:39.999075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68d6cada-4353-4693-8e05-c97b048d3154 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:39.999598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68d6cada-4353-4693-8e05-c97b048d3154 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:40.041942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-64732c9f-97e5-4d9b-ba44-11b597634146 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lazy-loading 'services' on Instance uuid 0656c7c5-439a-47a8-ab73-8a5e4e007bbd {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:47:40.172195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-68d6cada-4353-4693-8e05-c97b048d3154 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lazy-loading 'services' on Instance uuid 0eebf65c-de9c-4548-aab3-63d7c52a229c {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:47:40.227611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-64732c9f-97e5-4d9b-ba44-11b597634146 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8795698d-83c4-4eba-9908-89858964c729) Apr 19 03:47:40.228376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-64732c9f-97e5-4d9b-ba44-11b597634146 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8795698d-83c4-4eba-9908-89858964c729) {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:47:40.229362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-64732c9f-97e5-4d9b-ba44-11b597634146 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/ea016622-7478-41dc-b517-a7a657ca032b" status: 400 len: 269 microversion: 2.1 time: 0.376439 Apr 19 03:47:40.230064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 482/1011] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:47:39 2021] DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/ea016622-7478-41dc-b517-a7a657ca032b => generated 269 bytes in 378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 03:47:40.307236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-68d6cada-4353-4693-8e05-c97b048d3154 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b1b7727b-4fed-4432-b9f2-ca8f5672f018) Apr 19 03:47:40.307923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-68d6cada-4353-4693-8e05-c97b048d3154 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b1b7727b-4fed-4432-b9f2-ca8f5672f018) {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:47:40.308841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-68d6cada-4353-4693-8e05-c97b048d3154 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/os-volume_attachments/5699cd4c-a391-49a6-85cd-09fde627babe" status: 400 len: 269 microversion: 2.1 time: 0.323846 Apr 19 03:47:40.309538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 530/1012] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:47:39 2021] DELETE /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c/os-volume_attachments/5699cd4c-a391-49a6-85cd-09fde627babe => generated 269 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 03:47:40.409131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b992a6f8-08b6-4ef4-baab-ccc62d3ee95d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:40.409705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b992a6f8-08b6-4ef4-baab-ccc62d3ee95d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:40.418020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b992a6f8-08b6-4ef4-baab-ccc62d3ee95d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:40.418519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b992a6f8-08b6-4ef4-baab-ccc62d3ee95d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:40.419382 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b992a6f8-08b6-4ef4-baab-ccc62d3ee95d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:40.419871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b992a6f8-08b6-4ef4-baab-ccc62d3ee95d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:40.736080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-b992a6f8-08b6-4ef4-baab-ccc62d3ee95d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lazy-loading 'services' on Instance uuid 0656c7c5-439a-47a8-ab73-8a5e4e007bbd {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:47:40.869571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-93129ae3-8810-49b3-8348-6f45eda57960 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:40.870351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-93129ae3-8810-49b3-8348-6f45eda57960 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:40.881709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93129ae3-8810-49b3-8348-6f45eda57960 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:40.882216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93129ae3-8810-49b3-8348-6f45eda57960 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:40.883048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93129ae3-8810-49b3-8348-6f45eda57960 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:40.883564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93129ae3-8810-49b3-8348-6f45eda57960 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:40.926990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b992a6f8-08b6-4ef4-baab-ccc62d3ee95d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/bb75078c-071a-4703-9026-5e35342b7eed" status: 202 len: 0 microversion: 2.1 time: 0.521751 Apr 19 03:47:40.927731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 483/1013] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:47:40 2021] DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd/os-volume_attachments/bb75078c-071a-4703-9026-5e35342b7eed => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:47:40.936094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-93129ae3-8810-49b3-8348-6f45eda57960 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] HTTP exception thrown: Instance b1e2695b-dd12-444c-8d09-a65518f70b76 could not be found. Apr 19 03:47:40.936769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-93129ae3-8810-49b3-8348-6f45eda57960 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Returning 404 to user: Instance b1e2695b-dd12-444c-8d09-a65518f70b76 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:47:40.937666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-93129ae3-8810-49b3-8348-6f45eda57960 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 404 len: 111 microversion: 2.1 time: 0.072415 Apr 19 03:47:40.938431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 531/1014] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:40 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 03:47:40.992929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-399079908", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-785891168", "security_groups": [{"name": "tempest-secgroup-smoke-2104745756"}], "block_device_mapping_v2": [{"uuid": "5655f5d4-c54a-4a2d-a79e-a02833887977", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa5df436-235a-45f0-896c-3f8b6fe17aeb"}]}} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:47:41.003774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-464782f1-13bb-4e9d-a57a-ef3b6ebd9e6c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:41.005128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-464782f1-13bb-4e9d-a57a-ef3b6ebd9e6c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:41.014063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-464782f1-13bb-4e9d-a57a-ef3b6ebd9e6c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:41.014675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-464782f1-13bb-4e9d-a57a-ef3b6ebd9e6c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:41.015655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-464782f1-13bb-4e9d-a57a-ef3b6ebd9e6c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:41.016258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-464782f1-13bb-4e9d-a57a-ef3b6ebd9e6c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:41.170154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] validate_networks() for [('aa5df436-235a-45f0-896c-3f8b6fe17aeb', None, None, None)] {{(pid=100590) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 03:47:41.236100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-464782f1-13bb-4e9d-a57a-ef3b6ebd9e6c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:41.245892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-464782f1-13bb-4e9d-a57a-ef3b6ebd9e6c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.247973 Apr 19 03:47:41.246481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 532/1015] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:40 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:41.738476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Flavor limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 03:47:41.739275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Image limits 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 03:47:41.739806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Flavor pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 03:47:41.740285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Image pref 0:0:0 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 03:47:41.740743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 03:47:41.749595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:41.750100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:41.750972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:41.751489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:41.770647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Getting quotas for project a012a767fda74dde8c60610167f3a08a. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 03:47:41.774878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Getting quotas for user 0e8af417bbfa4deda2c64b88a8d5c6ed and project a012a767fda74dde8c60610167f3a08a. Resources: {'cores', 'instances', 'ram'} {{(pid=100590) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 03:47:41.890084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Going to run 1 instances... {{(pid=100590) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 03:47:41.892749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: 6266cca1-a861-48a1-938d-4179e6321122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5655f5d4-c54a-4a2d-a79e-a02833887977',volume_size=None,volume_type=None)] {{(pid=100590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 03:47:42.034219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 5655f5d4-c54a-4a2d-a79e-a02833887977 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a12a1830-e7bc-4a4b-962f-0f7a86d4e44e) Apr 19 03:47:42.034897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 5655f5d4-c54a-4a2d-a79e-a02833887977 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a12a1830-e7bc-4a4b-962f-0f7a86d4e44e) {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:47:42.035854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-66767841-5db2-4366-90da-8175d7799ebe tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 1.048019 Apr 19 03:47:42.036488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 484/1016] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 03:47:40 2021] POST /compute/v2.1/servers => generated 295 bytes in 1049 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 03:47:42.264858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f502ac3a-7691-40e6-9a87-e6308330eb91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:42.265265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f502ac3a-7691-40e6-9a87-e6308330eb91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:42.273346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f502ac3a-7691-40e6-9a87-e6308330eb91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:42.273855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f502ac3a-7691-40e6-9a87-e6308330eb91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:42.274692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f502ac3a-7691-40e6-9a87-e6308330eb91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:42.275220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f502ac3a-7691-40e6-9a87-e6308330eb91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:42.485895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f502ac3a-7691-40e6-9a87-e6308330eb91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:42.495476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f502ac3a-7691-40e6-9a87-e6308330eb91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234948 Apr 19 03:47:42.496099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 533/1017] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:42 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:42.924204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2a4cea71-2dc0-4260-941c-705d6f456ce9 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:42.924769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2a4cea71-2dc0-4260-941c-705d6f456ce9 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:42.933313 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a4cea71-2dc0-4260-941c-705d6f456ce9 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:42.933823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a4cea71-2dc0-4260-941c-705d6f456ce9 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:42.934655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a4cea71-2dc0-4260-941c-705d6f456ce9 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:42.935180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a4cea71-2dc0-4260-941c-705d6f456ce9 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:42.986816 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-2a4cea71-2dc0-4260-941c-705d6f456ce9 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] HTTP exception thrown: Instance b1e2695b-dd12-444c-8d09-a65518f70b76 could not be found. Apr 19 03:47:42.987502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2a4cea71-2dc0-4260-941c-705d6f456ce9 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Returning 404 to user: Instance b1e2695b-dd12-444c-8d09-a65518f70b76 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:47:42.988420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2a4cea71-2dc0-4260-941c-705d6f456ce9 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 404 len: 111 microversion: 2.1 time: 0.068385 Apr 19 03:47:42.989266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 485/1018] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:47:42 2021] DELETE /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:47:42.997977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-54fdbe47-2012-4e40-9791-227556757204 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:42.998647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-54fdbe47-2012-4e40-9791-227556757204 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] [instance: b1e2695b-dd12-444c-8d09-a65518f70b76] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:43.006451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54fdbe47-2012-4e40-9791-227556757204 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:43.006954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54fdbe47-2012-4e40-9791-227556757204 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:43.007799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54fdbe47-2012-4e40-9791-227556757204 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:43.008294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54fdbe47-2012-4e40-9791-227556757204 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:43.063050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-54fdbe47-2012-4e40-9791-227556757204 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] HTTP exception thrown: Instance b1e2695b-dd12-444c-8d09-a65518f70b76 could not be found. Apr 19 03:47:43.063675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-54fdbe47-2012-4e40-9791-227556757204 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Returning 404 to user: Instance b1e2695b-dd12-444c-8d09-a65518f70b76 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:47:43.064550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-54fdbe47-2012-4e40-9791-227556757204 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76" status: 404 len: 111 microversion: 2.1 time: 0.070841 Apr 19 03:47:43.065127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 534/1019] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:42 2021] GET /compute/v2.1/servers/b1e2695b-dd12-444c-8d09-a65518f70b76 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:47:43.513805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a256201b-aa00-4b80-b708-7fbf5f5884f9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:43.514474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a256201b-aa00-4b80-b708-7fbf5f5884f9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:43.522759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a256201b-aa00-4b80-b708-7fbf5f5884f9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:43.523308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a256201b-aa00-4b80-b708-7fbf5f5884f9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:43.524116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a256201b-aa00-4b80-b708-7fbf5f5884f9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:43.524596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a256201b-aa00-4b80-b708-7fbf5f5884f9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:43.736472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a256201b-aa00-4b80-b708-7fbf5f5884f9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:43.746255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a256201b-aa00-4b80-b708-7fbf5f5884f9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236544 Apr 19 03:47:43.746864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 486/1020] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:43 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:44.765291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-77715ab3-4902-4503-8f79-b33fa4ae43c2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:44.765909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-77715ab3-4902-4503-8f79-b33fa4ae43c2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:44.774421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77715ab3-4902-4503-8f79-b33fa4ae43c2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:44.774928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77715ab3-4902-4503-8f79-b33fa4ae43c2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:44.775783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77715ab3-4902-4503-8f79-b33fa4ae43c2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:44.776276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77715ab3-4902-4503-8f79-b33fa4ae43c2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:44.990666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-77715ab3-4902-4503-8f79-b33fa4ae43c2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:44.999694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-77715ab3-4902-4503-8f79-b33fa4ae43c2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238624 Apr 19 03:47:45.000360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 535/1021] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:44 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:46.018691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9e6d574c-5e2f-41c1-b2de-41aa07ca3618 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:46.019392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9e6d574c-5e2f-41c1-b2de-41aa07ca3618 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:46.027750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e6d574c-5e2f-41c1-b2de-41aa07ca3618 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:46.028254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e6d574c-5e2f-41c1-b2de-41aa07ca3618 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:46.029069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e6d574c-5e2f-41c1-b2de-41aa07ca3618 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:46.029554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e6d574c-5e2f-41c1-b2de-41aa07ca3618 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:46.242183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9e6d574c-5e2f-41c1-b2de-41aa07ca3618 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:46.250957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9e6d574c-5e2f-41c1-b2de-41aa07ca3618 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236420 Apr 19 03:47:46.251615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 487/1022] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:46 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:47.269092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a52709a5-b47e-4c2a-864d-ce4ca9dbd3e8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:47.269813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a52709a5-b47e-4c2a-864d-ce4ca9dbd3e8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:47.278290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a52709a5-b47e-4c2a-864d-ce4ca9dbd3e8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:47.278802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a52709a5-b47e-4c2a-864d-ce4ca9dbd3e8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:47.279688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a52709a5-b47e-4c2a-864d-ce4ca9dbd3e8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:47.280184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a52709a5-b47e-4c2a-864d-ce4ca9dbd3e8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:47.489272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a52709a5-b47e-4c2a-864d-ce4ca9dbd3e8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:47.498245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a52709a5-b47e-4c2a-864d-ce4ca9dbd3e8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233199 Apr 19 03:47:47.498869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 536/1023] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:47 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:48.516870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-306d94c6-297f-4e5c-9219-a7a5111fe13f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:48.517542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-306d94c6-297f-4e5c-9219-a7a5111fe13f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:48.525288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-306d94c6-297f-4e5c-9219-a7a5111fe13f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:48.525784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-306d94c6-297f-4e5c-9219-a7a5111fe13f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:48.526611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-306d94c6-297f-4e5c-9219-a7a5111fe13f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:48.527097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-306d94c6-297f-4e5c-9219-a7a5111fe13f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:48.743016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-306d94c6-297f-4e5c-9219-a7a5111fe13f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:48.752075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-306d94c6-297f-4e5c-9219-a7a5111fe13f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239413 Apr 19 03:47:48.752699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 488/1024] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:48 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:49.770064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-31695a23-98c7-465e-b5fb-2fbaeeac7fb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:49.770780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-31695a23-98c7-465e-b5fb-2fbaeeac7fb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:49.778695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31695a23-98c7-465e-b5fb-2fbaeeac7fb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:49.779272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31695a23-98c7-465e-b5fb-2fbaeeac7fb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:49.780092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31695a23-98c7-465e-b5fb-2fbaeeac7fb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:49.780585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31695a23-98c7-465e-b5fb-2fbaeeac7fb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:49.995278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-31695a23-98c7-465e-b5fb-2fbaeeac7fb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:50.004119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-31695a23-98c7-465e-b5fb-2fbaeeac7fb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238215 Apr 19 03:47:50.004738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 537/1025] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:49 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:51.023123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0b8cda1c-31c1-4eb7-9117-b4793d89ef82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:51.023945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0b8cda1c-31c1-4eb7-9117-b4793d89ef82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:51.031753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b8cda1c-31c1-4eb7-9117-b4793d89ef82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:51.035345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b8cda1c-31c1-4eb7-9117-b4793d89ef82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:51.035345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b8cda1c-31c1-4eb7-9117-b4793d89ef82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:51.035345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b8cda1c-31c1-4eb7-9117-b4793d89ef82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:51.385631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0b8cda1c-31c1-4eb7-9117-b4793d89ef82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:51.395223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0b8cda1c-31c1-4eb7-9117-b4793d89ef82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.376976 Apr 19 03:47:51.395901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 489/1026] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:51 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:52.413411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-875de4df-a7a6-4bf4-a8b7-075b3ac2d19f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:52.414088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-875de4df-a7a6-4bf4-a8b7-075b3ac2d19f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:52.422050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-875de4df-a7a6-4bf4-a8b7-075b3ac2d19f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:52.422558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-875de4df-a7a6-4bf4-a8b7-075b3ac2d19f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:52.423417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-875de4df-a7a6-4bf4-a8b7-075b3ac2d19f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:52.423909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-875de4df-a7a6-4bf4-a8b7-075b3ac2d19f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:52.641151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-875de4df-a7a6-4bf4-a8b7-075b3ac2d19f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:52.650106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-875de4df-a7a6-4bf4-a8b7-075b3ac2d19f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240725 Apr 19 03:47:52.650732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 538/1027] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:52 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:53.667774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0ca389aa-e4c1-47cf-a548-a5820af716db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:53.668437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0ca389aa-e4c1-47cf-a548-a5820af716db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:53.676415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ca389aa-e4c1-47cf-a548-a5820af716db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:53.676920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ca389aa-e4c1-47cf-a548-a5820af716db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:53.677737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ca389aa-e4c1-47cf-a548-a5820af716db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:53.678263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ca389aa-e4c1-47cf-a548-a5820af716db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:54.121707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0ca389aa-e4c1-47cf-a548-a5820af716db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:54.131281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0ca389aa-e4c1-47cf-a548-a5820af716db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.467733 Apr 19 03:47:54.131885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 490/1028] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:53 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:55.150203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-041a0aa5-5b3f-4ca8-8ad1-213f4437b0be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:55.150825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-041a0aa5-5b3f-4ca8-8ad1-213f4437b0be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:55.158707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-041a0aa5-5b3f-4ca8-8ad1-213f4437b0be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:55.159243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-041a0aa5-5b3f-4ca8-8ad1-213f4437b0be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:55.160077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-041a0aa5-5b3f-4ca8-8ad1-213f4437b0be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:55.160569 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-041a0aa5-5b3f-4ca8-8ad1-213f4437b0be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:55.377720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-041a0aa5-5b3f-4ca8-8ad1-213f4437b0be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:55.387361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-041a0aa5-5b3f-4ca8-8ad1-213f4437b0be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.241882 Apr 19 03:47:55.388001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 539/1029] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:55 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:56.406240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ae5f12c2-9c78-43f5-bc46-fe1417e33189 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:56.406917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ae5f12c2-9c78-43f5-bc46-fe1417e33189 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:56.415392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae5f12c2-9c78-43f5-bc46-fe1417e33189 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:56.415905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae5f12c2-9c78-43f5-bc46-fe1417e33189 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:56.416740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae5f12c2-9c78-43f5-bc46-fe1417e33189 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:56.417234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae5f12c2-9c78-43f5-bc46-fe1417e33189 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:56.628118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ae5f12c2-9c78-43f5-bc46-fe1417e33189 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:56.637654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ae5f12c2-9c78-43f5-bc46-fe1417e33189 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235671 Apr 19 03:47:56.638366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 491/1030] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:56 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:57.657015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-df4ec7ca-5ac6-4ac1-9caa-ccd5bdfeb0b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:57.657683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-df4ec7ca-5ac6-4ac1-9caa-ccd5bdfeb0b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:57.666000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df4ec7ca-5ac6-4ac1-9caa-ccd5bdfeb0b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:57.666504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df4ec7ca-5ac6-4ac1-9caa-ccd5bdfeb0b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:57.667355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df4ec7ca-5ac6-4ac1-9caa-ccd5bdfeb0b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:57.667844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df4ec7ca-5ac6-4ac1-9caa-ccd5bdfeb0b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:57.886148 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-df4ec7ca-5ac6-4ac1-9caa-ccd5bdfeb0b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:57.895741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-df4ec7ca-5ac6-4ac1-9caa-ccd5bdfeb0b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.242554 Apr 19 03:47:57.896370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 540/1031] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:57 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:47:58.914300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d898ad6e-9c3e-4e73-a639-b89cf0df52ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:47:58.914976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d898ad6e-9c3e-4e73-a639-b89cf0df52ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:47:58.922737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d898ad6e-9c3e-4e73-a639-b89cf0df52ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:58.923277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d898ad6e-9c3e-4e73-a639-b89cf0df52ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:58.924106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d898ad6e-9c3e-4e73-a639-b89cf0df52ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:47:58.924595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d898ad6e-9c3e-4e73-a639-b89cf0df52ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:47:59.132830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d898ad6e-9c3e-4e73-a639-b89cf0df52ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:47:59.141630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d898ad6e-9c3e-4e73-a639-b89cf0df52ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.231903 Apr 19 03:47:59.142241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 492/1032] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:47:58 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:00.159872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3fd35e9d-9fbd-4d0b-b582-5bbdf1c37a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:00.160484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3fd35e9d-9fbd-4d0b-b582-5bbdf1c37a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:00.168291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd35e9d-9fbd-4d0b-b582-5bbdf1c37a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:00.168793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd35e9d-9fbd-4d0b-b582-5bbdf1c37a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:00.169615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd35e9d-9fbd-4d0b-b582-5bbdf1c37a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:00.170101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fd35e9d-9fbd-4d0b-b582-5bbdf1c37a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:00.381107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3fd35e9d-9fbd-4d0b-b582-5bbdf1c37a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:00.389925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3fd35e9d-9fbd-4d0b-b582-5bbdf1c37a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234119 Apr 19 03:48:00.390536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 541/1033] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:00 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:01.407989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-87101063-6d1d-4983-b7d4-da68dd6d32a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:01.408659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-87101063-6d1d-4983-b7d4-da68dd6d32a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:01.416888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87101063-6d1d-4983-b7d4-da68dd6d32a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:01.417389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87101063-6d1d-4983-b7d4-da68dd6d32a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:01.418212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87101063-6d1d-4983-b7d4-da68dd6d32a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:01.418699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87101063-6d1d-4983-b7d4-da68dd6d32a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:01.636601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-87101063-6d1d-4983-b7d4-da68dd6d32a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:01.645947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-87101063-6d1d-4983-b7d4-da68dd6d32a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.241569 Apr 19 03:48:01.646550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 493/1034] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:01 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:02.664552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-014a7589-512e-4d16-8cf5-217f43f407e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:02.665222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-014a7589-512e-4d16-8cf5-217f43f407e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:02.673164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-014a7589-512e-4d16-8cf5-217f43f407e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:02.673731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-014a7589-512e-4d16-8cf5-217f43f407e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:02.674541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-014a7589-512e-4d16-8cf5-217f43f407e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:02.675023 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-014a7589-512e-4d16-8cf5-217f43f407e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:02.945071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-014a7589-512e-4d16-8cf5-217f43f407e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:02.953860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-014a7589-512e-4d16-8cf5-217f43f407e4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.293443 Apr 19 03:48:02.954468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 542/1035] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:02 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:03.972695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c0e3ddfa-5aa9-4f37-ae80-14c6e8e245ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:03.973970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c0e3ddfa-5aa9-4f37-ae80-14c6e8e245ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:03.981783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0e3ddfa-5aa9-4f37-ae80-14c6e8e245ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:03.982292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0e3ddfa-5aa9-4f37-ae80-14c6e8e245ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:03.983128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0e3ddfa-5aa9-4f37-ae80-14c6e8e245ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:03.983643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0e3ddfa-5aa9-4f37-ae80-14c6e8e245ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:04.243776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c0e3ddfa-5aa9-4f37-ae80-14c6e8e245ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:04.252709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c0e3ddfa-5aa9-4f37-ae80-14c6e8e245ae tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.284097 Apr 19 03:48:04.253317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 494/1036] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:03 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:05.272082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7dc64afe-ad00-4a42-b04e-c54d093632ba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:05.272749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7dc64afe-ad00-4a42-b04e-c54d093632ba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:05.280557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7dc64afe-ad00-4a42-b04e-c54d093632ba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:05.281063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7dc64afe-ad00-4a42-b04e-c54d093632ba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:05.281892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7dc64afe-ad00-4a42-b04e-c54d093632ba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:05.282383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7dc64afe-ad00-4a42-b04e-c54d093632ba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:05.499078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7dc64afe-ad00-4a42-b04e-c54d093632ba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:05.508048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7dc64afe-ad00-4a42-b04e-c54d093632ba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240720 Apr 19 03:48:05.508651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 543/1037] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:05 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:06.526081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-15de5f7f-9b32-4f63-8944-0416a52d069b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:06.526755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-15de5f7f-9b32-4f63-8944-0416a52d069b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:06.534816 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-15de5f7f-9b32-4f63-8944-0416a52d069b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:06.535359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-15de5f7f-9b32-4f63-8944-0416a52d069b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:06.536701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-15de5f7f-9b32-4f63-8944-0416a52d069b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:06.537192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-15de5f7f-9b32-4f63-8944-0416a52d069b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:06.751215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-15de5f7f-9b32-4f63-8944-0416a52d069b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:06.760036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-15de5f7f-9b32-4f63-8944-0416a52d069b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238113 Apr 19 03:48:06.760644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 495/1038] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:06 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:07.778831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d6e5fed9-2375-4d1c-aac5-0cb646b6fd4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:07.779529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d6e5fed9-2375-4d1c-aac5-0cb646b6fd4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:07.787305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6e5fed9-2375-4d1c-aac5-0cb646b6fd4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:07.787807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6e5fed9-2375-4d1c-aac5-0cb646b6fd4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:07.788630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6e5fed9-2375-4d1c-aac5-0cb646b6fd4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:07.789113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6e5fed9-2375-4d1c-aac5-0cb646b6fd4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:07.999309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d6e5fed9-2375-4d1c-aac5-0cb646b6fd4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:08.008278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d6e5fed9-2375-4d1c-aac5-0cb646b6fd4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233674 Apr 19 03:48:08.011267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 544/1039] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:07 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:09.026444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ca5df4a7-bbf9-4702-bec2-804cea932b94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:09.027053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ca5df4a7-bbf9-4702-bec2-804cea932b94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:09.035014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca5df4a7-bbf9-4702-bec2-804cea932b94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:09.035565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca5df4a7-bbf9-4702-bec2-804cea932b94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:09.036404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca5df4a7-bbf9-4702-bec2-804cea932b94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:09.036893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca5df4a7-bbf9-4702-bec2-804cea932b94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:09.250871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ca5df4a7-bbf9-4702-bec2-804cea932b94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:09.260514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ca5df4a7-bbf9-4702-bec2-804cea932b94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238250 Apr 19 03:48:09.261140 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 496/1040] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:09 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:10.278785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2d39d074-1416-4434-9a65-bccfd12ecead tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:10.279606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2d39d074-1416-4434-9a65-bccfd12ecead tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:10.287452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d39d074-1416-4434-9a65-bccfd12ecead tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:10.287965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d39d074-1416-4434-9a65-bccfd12ecead tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:10.288795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d39d074-1416-4434-9a65-bccfd12ecead tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:10.289287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d39d074-1416-4434-9a65-bccfd12ecead tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:10.737354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2d39d074-1416-4434-9a65-bccfd12ecead tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:10.747401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2d39d074-1416-4434-9a65-bccfd12ecead tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.472622 Apr 19 03:48:10.748089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 545/1041] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:10 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:11.766737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c3ae7521-cf3e-45b0-8f0a-c2d8d1ca807d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:11.767439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c3ae7521-cf3e-45b0-8f0a-c2d8d1ca807d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:11.775974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3ae7521-cf3e-45b0-8f0a-c2d8d1ca807d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:11.776475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3ae7521-cf3e-45b0-8f0a-c2d8d1ca807d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:11.777301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3ae7521-cf3e-45b0-8f0a-c2d8d1ca807d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:11.777793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3ae7521-cf3e-45b0-8f0a-c2d8d1ca807d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:11.985384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c3ae7521-cf3e-45b0-8f0a-c2d8d1ca807d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:11.994906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c3ae7521-cf3e-45b0-8f0a-c2d8d1ca807d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.232388 Apr 19 03:48:11.995556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 497/1042] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:11 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:13.013125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d7436f04-ddb0-4c55-bcfc-7afc0f19e2fb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:13.013787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d7436f04-ddb0-4c55-bcfc-7afc0f19e2fb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:13.022060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7436f04-ddb0-4c55-bcfc-7afc0f19e2fb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:13.022570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7436f04-ddb0-4c55-bcfc-7afc0f19e2fb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:13.023425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7436f04-ddb0-4c55-bcfc-7afc0f19e2fb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:13.023912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7436f04-ddb0-4c55-bcfc-7afc0f19e2fb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:13.237283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d7436f04-ddb0-4c55-bcfc-7afc0f19e2fb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:13.246452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d7436f04-ddb0-4c55-bcfc-7afc0f19e2fb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237418 Apr 19 03:48:13.247066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 546/1043] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:13 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:14.265188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-82ae7577-dd9d-42be-987d-052e37433d8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:14.265855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-82ae7577-dd9d-42be-987d-052e37433d8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:14.274157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82ae7577-dd9d-42be-987d-052e37433d8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:14.274658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82ae7577-dd9d-42be-987d-052e37433d8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:14.275587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82ae7577-dd9d-42be-987d-052e37433d8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:14.276076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82ae7577-dd9d-42be-987d-052e37433d8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:14.491122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-82ae7577-dd9d-42be-987d-052e37433d8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:14.499926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-82ae7577-dd9d-42be-987d-052e37433d8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238845 Apr 19 03:48:14.500535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 498/1044] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:14 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:15.518112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-170eea2e-a8dc-4ebc-927b-f129c592ef21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:15.518773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-170eea2e-a8dc-4ebc-927b-f129c592ef21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:15.526566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-170eea2e-a8dc-4ebc-927b-f129c592ef21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:15.527065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-170eea2e-a8dc-4ebc-927b-f129c592ef21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:15.527949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-170eea2e-a8dc-4ebc-927b-f129c592ef21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:15.528430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-170eea2e-a8dc-4ebc-927b-f129c592ef21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:15.738103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-170eea2e-a8dc-4ebc-927b-f129c592ef21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:15.748130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-170eea2e-a8dc-4ebc-927b-f129c592ef21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234036 Apr 19 03:48:15.748755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 547/1045] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:15 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:16.766121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f825cd87-0cff-4de7-af53-9f6caf0af824 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:16.766730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f825cd87-0cff-4de7-af53-9f6caf0af824 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:16.774516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f825cd87-0cff-4de7-af53-9f6caf0af824 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:16.775026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f825cd87-0cff-4de7-af53-9f6caf0af824 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:16.775915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f825cd87-0cff-4de7-af53-9f6caf0af824 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:16.776387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f825cd87-0cff-4de7-af53-9f6caf0af824 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:16.991425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f825cd87-0cff-4de7-af53-9f6caf0af824 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:17.000378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f825cd87-0cff-4de7-af53-9f6caf0af824 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238392 Apr 19 03:48:17.000991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 499/1046] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:16 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:18.018092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9e745430-8219-4bbd-8cee-b73a4501a72a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:18.018899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9e745430-8219-4bbd-8cee-b73a4501a72a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:18.026959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e745430-8219-4bbd-8cee-b73a4501a72a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:18.027511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e745430-8219-4bbd-8cee-b73a4501a72a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:18.028482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e745430-8219-4bbd-8cee-b73a4501a72a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:18.028865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e745430-8219-4bbd-8cee-b73a4501a72a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:18.242321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9e745430-8219-4bbd-8cee-b73a4501a72a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:18.251188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9e745430-8219-4bbd-8cee-b73a4501a72a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237251 Apr 19 03:48:18.251844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 548/1047] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:18 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:19.270118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7dec340-2df5-4270-8e10-dea94af90dac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:19.270730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b7dec340-2df5-4270-8e10-dea94af90dac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:19.279518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7dec340-2df5-4270-8e10-dea94af90dac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:19.280019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7dec340-2df5-4270-8e10-dea94af90dac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:19.280834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7dec340-2df5-4270-8e10-dea94af90dac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:19.281360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7dec340-2df5-4270-8e10-dea94af90dac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:19.488649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b7dec340-2df5-4270-8e10-dea94af90dac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:19.498197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b7dec340-2df5-4270-8e10-dea94af90dac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.232258 Apr 19 03:48:19.498815 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 500/1048] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:19 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:20.516927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a51b5887-cfcf-46c5-8f2a-c999bb7b94b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:20.517602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a51b5887-cfcf-46c5-8f2a-c999bb7b94b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:20.525961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a51b5887-cfcf-46c5-8f2a-c999bb7b94b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:20.526466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a51b5887-cfcf-46c5-8f2a-c999bb7b94b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:20.527333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a51b5887-cfcf-46c5-8f2a-c999bb7b94b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:20.527829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a51b5887-cfcf-46c5-8f2a-c999bb7b94b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:20.740366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a51b5887-cfcf-46c5-8f2a-c999bb7b94b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:20.749192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a51b5887-cfcf-46c5-8f2a-c999bb7b94b0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236407 Apr 19 03:48:20.749816 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 549/1049] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:20 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:21.767954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ad57bccf-f700-4b95-9e5f-e27fabf05a89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:21.768623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ad57bccf-f700-4b95-9e5f-e27fabf05a89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:21.777135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ad57bccf-f700-4b95-9e5f-e27fabf05a89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:21.777661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ad57bccf-f700-4b95-9e5f-e27fabf05a89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:21.778487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ad57bccf-f700-4b95-9e5f-e27fabf05a89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:21.778978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ad57bccf-f700-4b95-9e5f-e27fabf05a89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:21.999246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ad57bccf-f700-4b95-9e5f-e27fabf05a89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:22.008234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ad57bccf-f700-4b95-9e5f-e27fabf05a89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.244312 Apr 19 03:48:22.008852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 501/1050] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:21 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:23.026326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4f404123-86e4-4dcb-8222-df35805acf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:23.026998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4f404123-86e4-4dcb-8222-df35805acf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:23.034720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f404123-86e4-4dcb-8222-df35805acf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:23.035268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f404123-86e4-4dcb-8222-df35805acf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:23.036071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f404123-86e4-4dcb-8222-df35805acf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:23.036554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f404123-86e4-4dcb-8222-df35805acf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:23.248777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4f404123-86e4-4dcb-8222-df35805acf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:23.257707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4f404123-86e4-4dcb-8222-df35805acf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235381 Apr 19 03:48:23.258328 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 550/1051] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:23 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:24.275949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fd063723-49dc-41df-ae17-c08cb1432693 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:24.276624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fd063723-49dc-41df-ae17-c08cb1432693 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:24.284466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd063723-49dc-41df-ae17-c08cb1432693 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:24.284970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd063723-49dc-41df-ae17-c08cb1432693 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:24.285799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd063723-49dc-41df-ae17-c08cb1432693 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:24.286292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd063723-49dc-41df-ae17-c08cb1432693 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:24.498820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fd063723-49dc-41df-ae17-c08cb1432693 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:24.507714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fd063723-49dc-41df-ae17-c08cb1432693 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235824 Apr 19 03:48:24.508462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 502/1052] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:24 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:25.525348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-442ad919-4c50-4d1d-8c0d-b771d260d16b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:25.526025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-442ad919-4c50-4d1d-8c0d-b771d260d16b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:25.534008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-442ad919-4c50-4d1d-8c0d-b771d260d16b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:25.534518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-442ad919-4c50-4d1d-8c0d-b771d260d16b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:25.535388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-442ad919-4c50-4d1d-8c0d-b771d260d16b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:25.535888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-442ad919-4c50-4d1d-8c0d-b771d260d16b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:25.752802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-442ad919-4c50-4d1d-8c0d-b771d260d16b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:25.762375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-442ad919-4c50-4d1d-8c0d-b771d260d16b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.241259 Apr 19 03:48:25.763208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 551/1053] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:25 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:26.779823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c882ff34-407f-464a-b55d-3d2063180e54 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:26.780506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c882ff34-407f-464a-b55d-3d2063180e54 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:26.788426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c882ff34-407f-464a-b55d-3d2063180e54 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:26.788936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c882ff34-407f-464a-b55d-3d2063180e54 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:26.789767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c882ff34-407f-464a-b55d-3d2063180e54 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:26.790260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c882ff34-407f-464a-b55d-3d2063180e54 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:27.007069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c882ff34-407f-464a-b55d-3d2063180e54 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:27.015864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c882ff34-407f-464a-b55d-3d2063180e54 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240131 Apr 19 03:48:27.016481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 503/1054] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:26 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:28.034335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8f9c56d4-2835-4065-bb6c-633e3a67c41e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:28.035190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8f9c56d4-2835-4065-bb6c-633e3a67c41e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:28.043732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f9c56d4-2835-4065-bb6c-633e3a67c41e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:28.044218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f9c56d4-2835-4065-bb6c-633e3a67c41e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:28.045077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f9c56d4-2835-4065-bb6c-633e3a67c41e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:28.045604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f9c56d4-2835-4065-bb6c-633e3a67c41e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:28.254263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8f9c56d4-2835-4065-bb6c-633e3a67c41e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:28.263604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8f9c56d4-2835-4065-bb6c-633e3a67c41e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233494 Apr 19 03:48:28.264227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 552/1055] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:28 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:29.282219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-31f9b4f3-6fb3-4b0f-b046-e775ced3e219 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:29.282859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-31f9b4f3-6fb3-4b0f-b046-e775ced3e219 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:29.291300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31f9b4f3-6fb3-4b0f-b046-e775ced3e219 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:29.291808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31f9b4f3-6fb3-4b0f-b046-e775ced3e219 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:29.292630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31f9b4f3-6fb3-4b0f-b046-e775ced3e219 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:29.293113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31f9b4f3-6fb3-4b0f-b046-e775ced3e219 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:29.509730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-31f9b4f3-6fb3-4b0f-b046-e775ced3e219 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:29.518568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-31f9b4f3-6fb3-4b0f-b046-e775ced3e219 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240551 Apr 19 03:48:29.519201 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 504/1056] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:29 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:30.537890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8bacf1bd-c1e9-44ac-9c94-3cb97ab1a9c8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:30.538590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8bacf1bd-c1e9-44ac-9c94-3cb97ab1a9c8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:30.546542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bacf1bd-c1e9-44ac-9c94-3cb97ab1a9c8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:30.547049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bacf1bd-c1e9-44ac-9c94-3cb97ab1a9c8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:30.547922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bacf1bd-c1e9-44ac-9c94-3cb97ab1a9c8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:30.548427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bacf1bd-c1e9-44ac-9c94-3cb97ab1a9c8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:30.758829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8bacf1bd-c1e9-44ac-9c94-3cb97ab1a9c8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:30.767640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8bacf1bd-c1e9-44ac-9c94-3cb97ab1a9c8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234437 Apr 19 03:48:30.768208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 553/1057] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:30 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:31.786090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0cbf6097-f203-41c8-a7e9-dd62c383344d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:31.786761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0cbf6097-f203-41c8-a7e9-dd62c383344d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:31.794580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cbf6097-f203-41c8-a7e9-dd62c383344d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:31.795086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cbf6097-f203-41c8-a7e9-dd62c383344d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:31.795948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cbf6097-f203-41c8-a7e9-dd62c383344d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:31.796434 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cbf6097-f203-41c8-a7e9-dd62c383344d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:32.008512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0cbf6097-f203-41c8-a7e9-dd62c383344d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:32.017467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0cbf6097-f203-41c8-a7e9-dd62c383344d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235474 Apr 19 03:48:32.018078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 505/1058] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:31 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:33.035247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9b29a5a1-0442-491c-b336-6f4c30cee9bb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:33.035924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9b29a5a1-0442-491c-b336-6f4c30cee9bb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:33.043730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b29a5a1-0442-491c-b336-6f4c30cee9bb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:33.044233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b29a5a1-0442-491c-b336-6f4c30cee9bb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:33.045061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b29a5a1-0442-491c-b336-6f4c30cee9bb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:33.045550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9b29a5a1-0442-491c-b336-6f4c30cee9bb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:33.254930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9b29a5a1-0442-491c-b336-6f4c30cee9bb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:33.264645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9b29a5a1-0442-491c-b336-6f4c30cee9bb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233474 Apr 19 03:48:33.265272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 554/1059] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:33 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:34.282849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c779c0b8-19be-41af-a572-a4d4683ba283 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:34.283545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c779c0b8-19be-41af-a572-a4d4683ba283 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:34.291412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c779c0b8-19be-41af-a572-a4d4683ba283 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:34.291915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c779c0b8-19be-41af-a572-a4d4683ba283 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:34.292736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c779c0b8-19be-41af-a572-a4d4683ba283 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:34.293223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c779c0b8-19be-41af-a572-a4d4683ba283 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:34.506139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c779c0b8-19be-41af-a572-a4d4683ba283 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:34.515069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c779c0b8-19be-41af-a572-a4d4683ba283 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236111 Apr 19 03:48:34.515702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 506/1060] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:34 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:35.533548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-99525c7e-fe7e-41f2-8e2c-15450a4ccf89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:35.534206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-99525c7e-fe7e-41f2-8e2c-15450a4ccf89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:35.543071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99525c7e-fe7e-41f2-8e2c-15450a4ccf89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:35.543622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99525c7e-fe7e-41f2-8e2c-15450a4ccf89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:35.544463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99525c7e-fe7e-41f2-8e2c-15450a4ccf89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:35.545086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99525c7e-fe7e-41f2-8e2c-15450a4ccf89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:35.762244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-99525c7e-fe7e-41f2-8e2c-15450a4ccf89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:35.772049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-99525c7e-fe7e-41f2-8e2c-15450a4ccf89 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.242754 Apr 19 03:48:35.772668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 555/1061] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:35 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:36.794877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-34b0a83e-3b36-4348-b80c-811107c51394 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:36.795589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-34b0a83e-3b36-4348-b80c-811107c51394 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:36.803692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34b0a83e-3b36-4348-b80c-811107c51394 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:36.804209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34b0a83e-3b36-4348-b80c-811107c51394 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:36.805047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34b0a83e-3b36-4348-b80c-811107c51394 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:36.805543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-34b0a83e-3b36-4348-b80c-811107c51394 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:37.017013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-34b0a83e-3b36-4348-b80c-811107c51394 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:37.026470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-34b0a83e-3b36-4348-b80c-811107c51394 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235722 Apr 19 03:48:37.027087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 507/1062] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:36 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:38.045309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f521bdcf-6d79-4670-8272-6bb7be06aba5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:38.046026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f521bdcf-6d79-4670-8272-6bb7be06aba5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:38.054710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f521bdcf-6d79-4670-8272-6bb7be06aba5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:38.055207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f521bdcf-6d79-4670-8272-6bb7be06aba5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:38.056038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f521bdcf-6d79-4670-8272-6bb7be06aba5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:38.056532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f521bdcf-6d79-4670-8272-6bb7be06aba5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:38.264773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f521bdcf-6d79-4670-8272-6bb7be06aba5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:38.274457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f521bdcf-6d79-4670-8272-6bb7be06aba5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233239 Apr 19 03:48:38.275082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 556/1063] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:38 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:39.292594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2675a42b-30ec-4550-a845-d2a1aac1750c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:39.293268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2675a42b-30ec-4550-a845-d2a1aac1750c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:39.301096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2675a42b-30ec-4550-a845-d2a1aac1750c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:39.302099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2675a42b-30ec-4550-a845-d2a1aac1750c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:39.302934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2675a42b-30ec-4550-a845-d2a1aac1750c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:39.303452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2675a42b-30ec-4550-a845-d2a1aac1750c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:39.517772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2675a42b-30ec-4550-a845-d2a1aac1750c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:39.526612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2675a42b-30ec-4550-a845-d2a1aac1750c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238075 Apr 19 03:48:39.527259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 508/1064] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:39 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:40.548905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6cc0aadb-0a18-4c33-84e7-997f1901ccf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:40.548905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6cc0aadb-0a18-4c33-84e7-997f1901ccf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:40.554504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cc0aadb-0a18-4c33-84e7-997f1901ccf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:40.555021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cc0aadb-0a18-4c33-84e7-997f1901ccf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:40.555909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cc0aadb-0a18-4c33-84e7-997f1901ccf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:40.556400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cc0aadb-0a18-4c33-84e7-997f1901ccf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:40.766902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6cc0aadb-0a18-4c33-84e7-997f1901ccf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:40.775832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6cc0aadb-0a18-4c33-84e7-997f1901ccf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234665 Apr 19 03:48:40.776457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 557/1065] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:40 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:41.793672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b8a26aec-8463-484d-9e81-57637c9ad238 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:41.794367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b8a26aec-8463-484d-9e81-57637c9ad238 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:41.802397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8a26aec-8463-484d-9e81-57637c9ad238 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:41.802906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8a26aec-8463-484d-9e81-57637c9ad238 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:41.803772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8a26aec-8463-484d-9e81-57637c9ad238 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:41.804264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b8a26aec-8463-484d-9e81-57637c9ad238 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:42.017316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b8a26aec-8463-484d-9e81-57637c9ad238 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:42.026407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b8a26aec-8463-484d-9e81-57637c9ad238 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236859 Apr 19 03:48:42.027019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 509/1066] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:41 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:43.044530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1d2dd4b9-60e8-4a62-878c-a670c8dd371b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:43.045200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1d2dd4b9-60e8-4a62-878c-a670c8dd371b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:43.053196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d2dd4b9-60e8-4a62-878c-a670c8dd371b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:43.053707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d2dd4b9-60e8-4a62-878c-a670c8dd371b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:43.054538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d2dd4b9-60e8-4a62-878c-a670c8dd371b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:43.055026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d2dd4b9-60e8-4a62-878c-a670c8dd371b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:43.264461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1d2dd4b9-60e8-4a62-878c-a670c8dd371b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:43.273936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1d2dd4b9-60e8-4a62-878c-a670c8dd371b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233474 Apr 19 03:48:43.274550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 558/1067] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:43 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:44.293157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7c4f980-7e91-4ac1-b2ca-bc8c7b0805f1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:44.293867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b7c4f980-7e91-4ac1-b2ca-bc8c7b0805f1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:44.301627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7c4f980-7e91-4ac1-b2ca-bc8c7b0805f1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:44.302131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7c4f980-7e91-4ac1-b2ca-bc8c7b0805f1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:44.302955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7c4f980-7e91-4ac1-b2ca-bc8c7b0805f1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:44.303463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7c4f980-7e91-4ac1-b2ca-bc8c7b0805f1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:44.519437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b7c4f980-7e91-4ac1-b2ca-bc8c7b0805f1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:44.528904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b7c4f980-7e91-4ac1-b2ca-bc8c7b0805f1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239755 Apr 19 03:48:44.529510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 510/1068] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:44 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:45.548306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-61ba258d-c00f-4841-84d9-91ccde718a64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:45.548838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-61ba258d-c00f-4841-84d9-91ccde718a64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:45.557556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-61ba258d-c00f-4841-84d9-91ccde718a64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:45.558071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-61ba258d-c00f-4841-84d9-91ccde718a64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:45.558908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-61ba258d-c00f-4841-84d9-91ccde718a64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:45.559429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-61ba258d-c00f-4841-84d9-91ccde718a64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:45.775567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-61ba258d-c00f-4841-84d9-91ccde718a64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:45.784524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-61ba258d-c00f-4841-84d9-91ccde718a64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240601 Apr 19 03:48:45.785142 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 559/1069] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:45 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:46.804069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-95fe6ea7-4031-4543-9bbc-b5a9b546f121 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:46.804744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-95fe6ea7-4031-4543-9bbc-b5a9b546f121 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:46.812525 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-95fe6ea7-4031-4543-9bbc-b5a9b546f121 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:46.813036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-95fe6ea7-4031-4543-9bbc-b5a9b546f121 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:46.813864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-95fe6ea7-4031-4543-9bbc-b5a9b546f121 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:46.814352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-95fe6ea7-4031-4543-9bbc-b5a9b546f121 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:47.024546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-95fe6ea7-4031-4543-9bbc-b5a9b546f121 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:47.033282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-95fe6ea7-4031-4543-9bbc-b5a9b546f121 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233959 Apr 19 03:48:47.033898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 511/1070] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:46 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:48.052457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3edf5d00-7aa5-4fb0-9586-85ab0e3505df tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:48.053072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3edf5d00-7aa5-4fb0-9586-85ab0e3505df tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:48.060893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3edf5d00-7aa5-4fb0-9586-85ab0e3505df tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:48.061394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3edf5d00-7aa5-4fb0-9586-85ab0e3505df tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:48.062214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3edf5d00-7aa5-4fb0-9586-85ab0e3505df tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:48.062774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3edf5d00-7aa5-4fb0-9586-85ab0e3505df tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:48.276747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3edf5d00-7aa5-4fb0-9586-85ab0e3505df tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:48.285639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3edf5d00-7aa5-4fb0-9586-85ab0e3505df tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237875 Apr 19 03:48:48.286262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 560/1071] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:48 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:49.304098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0986d722-9039-4d89-8dbd-8497869a7a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:49.304824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0986d722-9039-4d89-8dbd-8497869a7a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:49.312796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0986d722-9039-4d89-8dbd-8497869a7a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:49.313309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0986d722-9039-4d89-8dbd-8497869a7a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:49.314152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0986d722-9039-4d89-8dbd-8497869a7a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:49.314657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0986d722-9039-4d89-8dbd-8497869a7a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:49.525090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0986d722-9039-4d89-8dbd-8497869a7a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:49.533875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0986d722-9039-4d89-8dbd-8497869a7a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233785 Apr 19 03:48:49.534500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 512/1072] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:49 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:50.552093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-64087f30-db68-46c3-a372-f387983c1164 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:50.552764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-64087f30-db68-46c3-a372-f387983c1164 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:50.560624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64087f30-db68-46c3-a372-f387983c1164 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:50.561124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64087f30-db68-46c3-a372-f387983c1164 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:50.561944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64087f30-db68-46c3-a372-f387983c1164 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:50.562423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-64087f30-db68-46c3-a372-f387983c1164 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:50.774597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-64087f30-db68-46c3-a372-f387983c1164 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:50.783836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-64087f30-db68-46c3-a372-f387983c1164 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235880 Apr 19 03:48:50.784543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 561/1073] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:50 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:51.802105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-efa30b89-4d76-4f59-9b0e-cdf28dec3f9a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:51.802774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-efa30b89-4d76-4f59-9b0e-cdf28dec3f9a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:51.810541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efa30b89-4d76-4f59-9b0e-cdf28dec3f9a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:51.811040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efa30b89-4d76-4f59-9b0e-cdf28dec3f9a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:51.811906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efa30b89-4d76-4f59-9b0e-cdf28dec3f9a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:51.812389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efa30b89-4d76-4f59-9b0e-cdf28dec3f9a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:52.027844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-efa30b89-4d76-4f59-9b0e-cdf28dec3f9a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:52.037225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-efa30b89-4d76-4f59-9b0e-cdf28dec3f9a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238602 Apr 19 03:48:52.037835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 513/1074] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:51 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:53.055503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9884a669-0925-4c35-9e71-8d9472e87e97 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:53.056171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9884a669-0925-4c35-9e71-8d9472e87e97 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:53.064235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9884a669-0925-4c35-9e71-8d9472e87e97 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:53.064731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9884a669-0925-4c35-9e71-8d9472e87e97 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:53.065554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9884a669-0925-4c35-9e71-8d9472e87e97 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:53.066037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9884a669-0925-4c35-9e71-8d9472e87e97 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:53.282874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9884a669-0925-4c35-9e71-8d9472e87e97 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:53.292874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9884a669-0925-4c35-9e71-8d9472e87e97 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.241495 Apr 19 03:48:53.311252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 562/1075] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:53 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:54.316551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 19 03:48:54.320304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c24b441a-9e80-4f88-a6a2-0cf09ffb2b8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:54.321208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c24b441a-9e80-4f88-a6a2-0cf09ffb2b8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:54.329180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c24b441a-9e80-4f88-a6a2-0cf09ffb2b8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:54.329690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c24b441a-9e80-4f88-a6a2-0cf09ffb2b8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:54.330526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c24b441a-9e80-4f88-a6a2-0cf09ffb2b8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:54.331020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c24b441a-9e80-4f88-a6a2-0cf09ffb2b8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:54.546220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c24b441a-9e80-4f88-a6a2-0cf09ffb2b8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:54.555449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c24b441a-9e80-4f88-a6a2-0cf09ffb2b8f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240550 Apr 19 03:48:54.556067 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 514/1076] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:54 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:55.574157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7c4b83f7-bcc6-44f8-8707-224e9ee110f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:55.576261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7c4b83f7-bcc6-44f8-8707-224e9ee110f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:55.584874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c4b83f7-bcc6-44f8-8707-224e9ee110f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:55.585602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c4b83f7-bcc6-44f8-8707-224e9ee110f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:55.586431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c4b83f7-bcc6-44f8-8707-224e9ee110f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:55.586924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c4b83f7-bcc6-44f8-8707-224e9ee110f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:55.795078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7c4b83f7-bcc6-44f8-8707-224e9ee110f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:55.803914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7c4b83f7-bcc6-44f8-8707-224e9ee110f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233839 Apr 19 03:48:55.804529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 563/1077] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:55 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:56.822178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ca981564-97e5-4675-9e6f-7beebe9b49ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:56.822877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ca981564-97e5-4675-9e6f-7beebe9b49ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:56.841332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca981564-97e5-4675-9e6f-7beebe9b49ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:56.841839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca981564-97e5-4675-9e6f-7beebe9b49ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:56.842662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca981564-97e5-4675-9e6f-7beebe9b49ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:56.843167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca981564-97e5-4675-9e6f-7beebe9b49ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:56.880134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39172. Apr 19 03:48:57.053980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ca981564-97e5-4675-9e6f-7beebe9b49ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:57.063116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ca981564-97e5-4675-9e6f-7beebe9b49ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.245111 Apr 19 03:48:57.063780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 515/1078] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:56 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:58.081821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bb16b891-e7f0-42ba-b8f7-0db3e38e159b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:58.082495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bb16b891-e7f0-42ba-b8f7-0db3e38e159b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:58.090333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb16b891-e7f0-42ba-b8f7-0db3e38e159b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:58.090842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb16b891-e7f0-42ba-b8f7-0db3e38e159b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:58.091731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb16b891-e7f0-42ba-b8f7-0db3e38e159b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:58.092222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb16b891-e7f0-42ba-b8f7-0db3e38e159b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:58.309669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bb16b891-e7f0-42ba-b8f7-0db3e38e159b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:58.318634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bb16b891-e7f0-42ba-b8f7-0db3e38e159b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240944 Apr 19 03:48:58.319263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 564/1079] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:58 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:48:59.337186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8ec35132-ce17-479a-bc78-f03e42ae0201 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:48:59.337858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8ec35132-ce17-479a-bc78-f03e42ae0201 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:48:59.345789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ec35132-ce17-479a-bc78-f03e42ae0201 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:59.346296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ec35132-ce17-479a-bc78-f03e42ae0201 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:59.347117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ec35132-ce17-479a-bc78-f03e42ae0201 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:48:59.347631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ec35132-ce17-479a-bc78-f03e42ae0201 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:48:59.564492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8ec35132-ce17-479a-bc78-f03e42ae0201 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:48:59.574037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8ec35132-ce17-479a-bc78-f03e42ae0201 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240956 Apr 19 03:48:59.574811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 516/1080] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:48:59 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:00.592224 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8e1219e8-e1e3-4cc2-9059-afe73dcc74b7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:00.592895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8e1219e8-e1e3-4cc2-9059-afe73dcc74b7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:00.600885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e1219e8-e1e3-4cc2-9059-afe73dcc74b7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:00.601392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e1219e8-e1e3-4cc2-9059-afe73dcc74b7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:00.602223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e1219e8-e1e3-4cc2-9059-afe73dcc74b7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:00.602711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e1219e8-e1e3-4cc2-9059-afe73dcc74b7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:00.815627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8e1219e8-e1e3-4cc2-9059-afe73dcc74b7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:00.825189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8e1219e8-e1e3-4cc2-9059-afe73dcc74b7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237106 Apr 19 03:49:00.825802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 565/1081] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:00 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:01.843490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c697e949-b3e6-4f8a-a3d4-75c210266d0c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:01.844168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c697e949-b3e6-4f8a-a3d4-75c210266d0c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:01.852625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c697e949-b3e6-4f8a-a3d4-75c210266d0c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:01.853134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c697e949-b3e6-4f8a-a3d4-75c210266d0c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:01.853968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c697e949-b3e6-4f8a-a3d4-75c210266d0c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:01.854462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c697e949-b3e6-4f8a-a3d4-75c210266d0c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:02.063989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c697e949-b3e6-4f8a-a3d4-75c210266d0c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:02.073435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c697e949-b3e6-4f8a-a3d4-75c210266d0c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234108 Apr 19 03:49:02.074250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 517/1082] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:01 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:03.092329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f3d338e9-7f3c-46cb-b84e-a92ca7dd6736 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:03.093035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f3d338e9-7f3c-46cb-b84e-a92ca7dd6736 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:03.101475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3d338e9-7f3c-46cb-b84e-a92ca7dd6736 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:03.101977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3d338e9-7f3c-46cb-b84e-a92ca7dd6736 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:03.102798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3d338e9-7f3c-46cb-b84e-a92ca7dd6736 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:03.103330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f3d338e9-7f3c-46cb-b84e-a92ca7dd6736 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:03.315358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f3d338e9-7f3c-46cb-b84e-a92ca7dd6736 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:03.324470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f3d338e9-7f3c-46cb-b84e-a92ca7dd6736 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236220 Apr 19 03:49:03.325081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 566/1083] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:03 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:04.343035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7e5dfc93-0abd-4c62-a2f8-9a4dad222f66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:04.343781 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7e5dfc93-0abd-4c62-a2f8-9a4dad222f66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:04.352053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e5dfc93-0abd-4c62-a2f8-9a4dad222f66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:04.352562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e5dfc93-0abd-4c62-a2f8-9a4dad222f66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:04.353406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e5dfc93-0abd-4c62-a2f8-9a4dad222f66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:04.353898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e5dfc93-0abd-4c62-a2f8-9a4dad222f66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:04.567999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7e5dfc93-0abd-4c62-a2f8-9a4dad222f66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:04.577095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7e5dfc93-0abd-4c62-a2f8-9a4dad222f66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238153 Apr 19 03:49:04.577850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 518/1084] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:04 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:05.596415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f27ca884-48af-4720-a7d8-aff956dd6b66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:05.597091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f27ca884-48af-4720-a7d8-aff956dd6b66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:05.605621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f27ca884-48af-4720-a7d8-aff956dd6b66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:05.606126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f27ca884-48af-4720-a7d8-aff956dd6b66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:05.606949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f27ca884-48af-4720-a7d8-aff956dd6b66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:05.607487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f27ca884-48af-4720-a7d8-aff956dd6b66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:05.821394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f27ca884-48af-4720-a7d8-aff956dd6b66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:05.830306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f27ca884-48af-4720-a7d8-aff956dd6b66 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238076 Apr 19 03:49:05.831004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 567/1085] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:05 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:06.848887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a34617f3-b46d-4047-8477-2fa6d24eaffb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:06.849611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a34617f3-b46d-4047-8477-2fa6d24eaffb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:06.857699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a34617f3-b46d-4047-8477-2fa6d24eaffb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:06.858206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a34617f3-b46d-4047-8477-2fa6d24eaffb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:06.859032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a34617f3-b46d-4047-8477-2fa6d24eaffb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:06.859570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a34617f3-b46d-4047-8477-2fa6d24eaffb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:07.070374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a34617f3-b46d-4047-8477-2fa6d24eaffb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:07.079280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a34617f3-b46d-4047-8477-2fa6d24eaffb tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234677 Apr 19 03:49:07.079943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 519/1086] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:06 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:08.097977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-831feb70-107e-4ef1-8a50-cb8b4cd945fe tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:08.098644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-831feb70-107e-4ef1-8a50-cb8b4cd945fe tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:08.108299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 19 03:49:08.108299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-831feb70-107e-4ef1-8a50-cb8b4cd945fe tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:08.108299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-831feb70-107e-4ef1-8a50-cb8b4cd945fe tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:08.108853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-831feb70-107e-4ef1-8a50-cb8b4cd945fe tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:08.109341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-831feb70-107e-4ef1-8a50-cb8b4cd945fe tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:08.333882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-831feb70-107e-4ef1-8a50-cb8b4cd945fe tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:08.342760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-831feb70-107e-4ef1-8a50-cb8b4cd945fe tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.249071 Apr 19 03:49:08.343409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 568/1087] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:08 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:09.361197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1ea16777-1f4e-48e8-9c10-14018150eba1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:09.361808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1ea16777-1f4e-48e8-9c10-14018150eba1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:09.370046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ea16777-1f4e-48e8-9c10-14018150eba1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:09.370551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ea16777-1f4e-48e8-9c10-14018150eba1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:09.371409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ea16777-1f4e-48e8-9c10-14018150eba1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:09.371905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ea16777-1f4e-48e8-9c10-14018150eba1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:09.588067 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1ea16777-1f4e-48e8-9c10-14018150eba1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:09.597105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1ea16777-1f4e-48e8-9c10-14018150eba1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240057 Apr 19 03:49:09.597727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 520/1088] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:09 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:10.615567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2f15808d-659f-4039-a8d9-02b4a0dda79e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:10.616234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2f15808d-659f-4039-a8d9-02b4a0dda79e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:10.635608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f15808d-659f-4039-a8d9-02b4a0dda79e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:10.636114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f15808d-659f-4039-a8d9-02b4a0dda79e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:10.636941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f15808d-659f-4039-a8d9-02b4a0dda79e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:10.637425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f15808d-659f-4039-a8d9-02b4a0dda79e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:10.692871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39320. Apr 19 03:49:10.853330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2f15808d-659f-4039-a8d9-02b4a0dda79e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:10.862391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2f15808d-659f-4039-a8d9-02b4a0dda79e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.251168 Apr 19 03:49:10.863015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 569/1089] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:10 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:11.881575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a1b2444a-6372-4677-a300-f3c45de8631c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:11.882192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a1b2444a-6372-4677-a300-f3c45de8631c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:11.890078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1b2444a-6372-4677-a300-f3c45de8631c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:11.890587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1b2444a-6372-4677-a300-f3c45de8631c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:11.891467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1b2444a-6372-4677-a300-f3c45de8631c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:11.891966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1b2444a-6372-4677-a300-f3c45de8631c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:12.107176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a1b2444a-6372-4677-a300-f3c45de8631c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:12.116339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a1b2444a-6372-4677-a300-f3c45de8631c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239064 Apr 19 03:49:12.116957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 521/1090] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:11 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:13.134494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cdfae537-0a2b-472c-9134-c51678aa37a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:13.135174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cdfae537-0a2b-472c-9134-c51678aa37a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:13.143317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdfae537-0a2b-472c-9134-c51678aa37a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:13.143823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdfae537-0a2b-472c-9134-c51678aa37a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:13.144668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdfae537-0a2b-472c-9134-c51678aa37a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:13.145159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdfae537-0a2b-472c-9134-c51678aa37a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:13.361070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cdfae537-0a2b-472c-9134-c51678aa37a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:13.370901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cdfae537-0a2b-472c-9134-c51678aa37a3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240598 Apr 19 03:49:13.371552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 570/1091] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:13 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:14.388720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8d5cbc9b-73d0-4316-be17-55999ebcc214 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:14.389426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8d5cbc9b-73d0-4316-be17-55999ebcc214 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:14.397263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d5cbc9b-73d0-4316-be17-55999ebcc214 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:14.397778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d5cbc9b-73d0-4316-be17-55999ebcc214 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:14.398611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d5cbc9b-73d0-4316-be17-55999ebcc214 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:14.399099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8d5cbc9b-73d0-4316-be17-55999ebcc214 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:14.615554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8d5cbc9b-73d0-4316-be17-55999ebcc214 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:14.624651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8d5cbc9b-73d0-4316-be17-55999ebcc214 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240070 Apr 19 03:49:14.625273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 522/1092] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:14 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:15.642971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d413b05f-d8fb-4b86-aa1f-85461c3ed226 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:15.643680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d413b05f-d8fb-4b86-aa1f-85461c3ed226 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:15.652290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d413b05f-d8fb-4b86-aa1f-85461c3ed226 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:15.652796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d413b05f-d8fb-4b86-aa1f-85461c3ed226 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:15.653629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d413b05f-d8fb-4b86-aa1f-85461c3ed226 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:15.654122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d413b05f-d8fb-4b86-aa1f-85461c3ed226 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:15.863765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d413b05f-d8fb-4b86-aa1f-85461c3ed226 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:15.873314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d413b05f-d8fb-4b86-aa1f-85461c3ed226 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234472 Apr 19 03:49:15.873935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 571/1093] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:15 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:16.892323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9149796a-5e4b-4da1-92b0-658578bb0105 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:16.892996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9149796a-5e4b-4da1-92b0-658578bb0105 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:16.901423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9149796a-5e4b-4da1-92b0-658578bb0105 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:16.901932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9149796a-5e4b-4da1-92b0-658578bb0105 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:16.902763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9149796a-5e4b-4da1-92b0-658578bb0105 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:16.903277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9149796a-5e4b-4da1-92b0-658578bb0105 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:17.113399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9149796a-5e4b-4da1-92b0-658578bb0105 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:17.122493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9149796a-5e4b-4da1-92b0-658578bb0105 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234356 Apr 19 03:49:17.123106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 523/1094] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:16 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:18.141293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6793988e-e63a-4fd8-995f-8a4ffc3dfacc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:18.141908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6793988e-e63a-4fd8-995f-8a4ffc3dfacc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:18.150454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6793988e-e63a-4fd8-995f-8a4ffc3dfacc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:18.150946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6793988e-e63a-4fd8-995f-8a4ffc3dfacc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:18.151799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6793988e-e63a-4fd8-995f-8a4ffc3dfacc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:18.152285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6793988e-e63a-4fd8-995f-8a4ffc3dfacc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:18.364397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6793988e-e63a-4fd8-995f-8a4ffc3dfacc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:18.373643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6793988e-e63a-4fd8-995f-8a4ffc3dfacc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236547 Apr 19 03:49:18.374274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 572/1095] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:18 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:19.392816 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3b46d3cb-917e-46a8-9518-ae634b3791af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:19.393420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3b46d3cb-917e-46a8-9518-ae634b3791af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:19.401256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b46d3cb-917e-46a8-9518-ae634b3791af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:19.401804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b46d3cb-917e-46a8-9518-ae634b3791af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:19.402627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b46d3cb-917e-46a8-9518-ae634b3791af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:19.403111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3b46d3cb-917e-46a8-9518-ae634b3791af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:19.614709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3b46d3cb-917e-46a8-9518-ae634b3791af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:19.624156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3b46d3cb-917e-46a8-9518-ae634b3791af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235516 Apr 19 03:49:19.625049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 524/1096] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:19 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:20.642311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-251ccc46-af46-404c-b587-42e404a0301c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:20.643029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-251ccc46-af46-404c-b587-42e404a0301c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:20.650934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-251ccc46-af46-404c-b587-42e404a0301c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:20.651478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-251ccc46-af46-404c-b587-42e404a0301c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:20.652307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-251ccc46-af46-404c-b587-42e404a0301c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:20.652796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-251ccc46-af46-404c-b587-42e404a0301c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:20.865815 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-251ccc46-af46-404c-b587-42e404a0301c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:20.874940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-251ccc46-af46-404c-b587-42e404a0301c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236650 Apr 19 03:49:20.875595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 573/1097] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:20 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:21.893536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9e55113e-09ed-4349-a233-9071d2aa6479 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:21.894211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9e55113e-09ed-4349-a233-9071d2aa6479 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:21.902026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e55113e-09ed-4349-a233-9071d2aa6479 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:21.902528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e55113e-09ed-4349-a233-9071d2aa6479 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:21.903388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e55113e-09ed-4349-a233-9071d2aa6479 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:21.903880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9e55113e-09ed-4349-a233-9071d2aa6479 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:22.120305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9e55113e-09ed-4349-a233-9071d2aa6479 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:22.129118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9e55113e-09ed-4349-a233-9071d2aa6479 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239839 Apr 19 03:49:22.129736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 525/1098] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:21 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:23.147992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-53ab29df-4b0b-4e35-ae5e-4ae8455fdbe3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:23.148706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-53ab29df-4b0b-4e35-ae5e-4ae8455fdbe3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:23.156453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53ab29df-4b0b-4e35-ae5e-4ae8455fdbe3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:23.156955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53ab29df-4b0b-4e35-ae5e-4ae8455fdbe3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:23.157770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53ab29df-4b0b-4e35-ae5e-4ae8455fdbe3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:23.158254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53ab29df-4b0b-4e35-ae5e-4ae8455fdbe3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:23.598510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-53ab29df-4b0b-4e35-ae5e-4ae8455fdbe3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:23.608089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-53ab29df-4b0b-4e35-ae5e-4ae8455fdbe3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.464845 Apr 19 03:49:23.608700 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 574/1099] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:23 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:49:24.627275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d8d569d9-bf92-4d47-98bf-fc47f836dac7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:24.627953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d8d569d9-bf92-4d47-98bf-fc47f836dac7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:24.636304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8d569d9-bf92-4d47-98bf-fc47f836dac7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:24.636815 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8d569d9-bf92-4d47-98bf-fc47f836dac7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:24.637650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8d569d9-bf92-4d47-98bf-fc47f836dac7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:24.638146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8d569d9-bf92-4d47-98bf-fc47f836dac7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:24.851855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d8d569d9-bf92-4d47-98bf-fc47f836dac7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:24.860726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d8d569d9-bf92-4d47-98bf-fc47f836dac7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237559 Apr 19 03:49:24.861349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 526/1100] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:24 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:25.879380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4452f070-ee9c-496e-83fb-f2fe98401d96 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:25.879988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4452f070-ee9c-496e-83fb-f2fe98401d96 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:25.888299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4452f070-ee9c-496e-83fb-f2fe98401d96 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:25.888799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4452f070-ee9c-496e-83fb-f2fe98401d96 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:25.889621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4452f070-ee9c-496e-83fb-f2fe98401d96 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:25.890103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4452f070-ee9c-496e-83fb-f2fe98401d96 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:26.100458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4452f070-ee9c-496e-83fb-f2fe98401d96 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:26.109286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4452f070-ee9c-496e-83fb-f2fe98401d96 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234061 Apr 19 03:49:26.110088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 575/1101] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:25 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:27.127470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e0492f25-fef9-4f4b-a080-d94cb2753570 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:27.128152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e0492f25-fef9-4f4b-a080-d94cb2753570 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:27.136073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e0492f25-fef9-4f4b-a080-d94cb2753570 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:27.136591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e0492f25-fef9-4f4b-a080-d94cb2753570 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:27.137428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e0492f25-fef9-4f4b-a080-d94cb2753570 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:27.137923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e0492f25-fef9-4f4b-a080-d94cb2753570 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:27.347086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e0492f25-fef9-4f4b-a080-d94cb2753570 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:27.356196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e0492f25-fef9-4f4b-a080-d94cb2753570 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.232875 Apr 19 03:49:27.356818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 527/1102] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:27 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:28.374159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bbb3202c-2e58-4f03-902f-5dc269f93bf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:28.374831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bbb3202c-2e58-4f03-902f-5dc269f93bf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:28.382661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbb3202c-2e58-4f03-902f-5dc269f93bf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:28.383179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbb3202c-2e58-4f03-902f-5dc269f93bf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:28.384034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbb3202c-2e58-4f03-902f-5dc269f93bf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:28.384525 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bbb3202c-2e58-4f03-902f-5dc269f93bf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:28.601713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bbb3202c-2e58-4f03-902f-5dc269f93bf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:28.610972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bbb3202c-2e58-4f03-902f-5dc269f93bf1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240920 Apr 19 03:49:28.611754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 576/1103] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:28 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:29.629787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bfaad6e3-fa63-4d3d-8a48-79d452d8ba82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:29.630435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bfaad6e3-fa63-4d3d-8a48-79d452d8ba82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:29.642695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfaad6e3-fa63-4d3d-8a48-79d452d8ba82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:29.642695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfaad6e3-fa63-4d3d-8a48-79d452d8ba82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:29.642695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfaad6e3-fa63-4d3d-8a48-79d452d8ba82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:29.642695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfaad6e3-fa63-4d3d-8a48-79d452d8ba82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:29.860617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bfaad6e3-fa63-4d3d-8a48-79d452d8ba82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:29.870196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bfaad6e3-fa63-4d3d-8a48-79d452d8ba82 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.244462 Apr 19 03:49:29.870824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 528/1104] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:29 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:30.888432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c15e0314-c7d8-48bc-90e2-06f92290d55d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:30.889108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c15e0314-c7d8-48bc-90e2-06f92290d55d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:30.896917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c15e0314-c7d8-48bc-90e2-06f92290d55d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:30.897420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c15e0314-c7d8-48bc-90e2-06f92290d55d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:30.898249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c15e0314-c7d8-48bc-90e2-06f92290d55d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:30.898746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c15e0314-c7d8-48bc-90e2-06f92290d55d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:31.107431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c15e0314-c7d8-48bc-90e2-06f92290d55d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:31.116996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c15e0314-c7d8-48bc-90e2-06f92290d55d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.232704 Apr 19 03:49:31.117601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 577/1105] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:30 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:32.136073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-524fd36a-7dfa-45b1-8878-778f3d9536af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:32.136747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-524fd36a-7dfa-45b1-8878-778f3d9536af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:32.144567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-524fd36a-7dfa-45b1-8878-778f3d9536af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:32.145055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-524fd36a-7dfa-45b1-8878-778f3d9536af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:32.146497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-524fd36a-7dfa-45b1-8878-778f3d9536af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:32.147006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-524fd36a-7dfa-45b1-8878-778f3d9536af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:32.359811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-524fd36a-7dfa-45b1-8878-778f3d9536af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:32.369533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-524fd36a-7dfa-45b1-8878-778f3d9536af tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237661 Apr 19 03:49:32.370163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 529/1106] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:32 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:33.387446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fbc1e4ec-1197-492c-97dd-59d25a498a72 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:33.388121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fbc1e4ec-1197-492c-97dd-59d25a498a72 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:33.396465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fbc1e4ec-1197-492c-97dd-59d25a498a72 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:33.396976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fbc1e4ec-1197-492c-97dd-59d25a498a72 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:33.397795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fbc1e4ec-1197-492c-97dd-59d25a498a72 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:33.398280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fbc1e4ec-1197-492c-97dd-59d25a498a72 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:33.612617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fbc1e4ec-1197-492c-97dd-59d25a498a72 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:33.621774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fbc1e4ec-1197-492c-97dd-59d25a498a72 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238404 Apr 19 03:49:33.622380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 578/1107] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:33 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:34.639939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0794373d-5d97-4bf9-90c5-2d007e657909 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:34.640611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0794373d-5d97-4bf9-90c5-2d007e657909 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:34.649066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0794373d-5d97-4bf9-90c5-2d007e657909 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:34.649569 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0794373d-5d97-4bf9-90c5-2d007e657909 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:34.650393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0794373d-5d97-4bf9-90c5-2d007e657909 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:34.650879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0794373d-5d97-4bf9-90c5-2d007e657909 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:34.858539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0794373d-5d97-4bf9-90c5-2d007e657909 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:34.867960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0794373d-5d97-4bf9-90c5-2d007e657909 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.232098 Apr 19 03:49:34.868581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 530/1108] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:34 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:35.885946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a33aeb88-1820-444d-a37a-6aea59f23cff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:35.886619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a33aeb88-1820-444d-a37a-6aea59f23cff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:35.894482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a33aeb88-1820-444d-a37a-6aea59f23cff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:35.894990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a33aeb88-1820-444d-a37a-6aea59f23cff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:35.895840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a33aeb88-1820-444d-a37a-6aea59f23cff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:35.896332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a33aeb88-1820-444d-a37a-6aea59f23cff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:36.107296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a33aeb88-1820-444d-a37a-6aea59f23cff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:36.116426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a33aeb88-1820-444d-a37a-6aea59f23cff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234606 Apr 19 03:49:36.117048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 579/1109] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:35 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:37.134346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4d7b4324-13f9-4afd-9ccb-2b25ad5b4c9b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:37.135059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4d7b4324-13f9-4afd-9ccb-2b25ad5b4c9b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:37.142834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d7b4324-13f9-4afd-9ccb-2b25ad5b4c9b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:37.143404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d7b4324-13f9-4afd-9ccb-2b25ad5b4c9b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:37.144231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d7b4324-13f9-4afd-9ccb-2b25ad5b4c9b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:37.144719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4d7b4324-13f9-4afd-9ccb-2b25ad5b4c9b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:37.360574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4d7b4324-13f9-4afd-9ccb-2b25ad5b4c9b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:37.370676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4d7b4324-13f9-4afd-9ccb-2b25ad5b4c9b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240534 Apr 19 03:49:37.371307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 531/1110] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:37 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:38.388773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f87fe625-21b3-4f51-8208-64699eef220c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:38.389442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f87fe625-21b3-4f51-8208-64699eef220c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:38.397291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f87fe625-21b3-4f51-8208-64699eef220c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:38.397791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f87fe625-21b3-4f51-8208-64699eef220c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:38.398618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f87fe625-21b3-4f51-8208-64699eef220c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:38.399098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f87fe625-21b3-4f51-8208-64699eef220c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:38.621587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f87fe625-21b3-4f51-8208-64699eef220c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:38.631018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f87fe625-21b3-4f51-8208-64699eef220c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.246130 Apr 19 03:49:38.631681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 580/1111] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:38 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:39.650613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7ae7d42e-2c1b-4c87-941d-37aad8aa406f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:39.651359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7ae7d42e-2c1b-4c87-941d-37aad8aa406f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:39.659324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ae7d42e-2c1b-4c87-941d-37aad8aa406f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:39.659839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ae7d42e-2c1b-4c87-941d-37aad8aa406f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:39.660676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ae7d42e-2c1b-4c87-941d-37aad8aa406f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:39.661170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ae7d42e-2c1b-4c87-941d-37aad8aa406f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:39.872116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7ae7d42e-2c1b-4c87-941d-37aad8aa406f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:39.881912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7ae7d42e-2c1b-4c87-941d-37aad8aa406f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235987 Apr 19 03:49:39.882542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 532/1112] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:39 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:40.901962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9727d5bb-3b30-4d94-86d0-cbea14735d4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:40.902565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9727d5bb-3b30-4d94-86d0-cbea14735d4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:40.910354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9727d5bb-3b30-4d94-86d0-cbea14735d4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:40.910854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9727d5bb-3b30-4d94-86d0-cbea14735d4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:40.911720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9727d5bb-3b30-4d94-86d0-cbea14735d4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:40.912205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9727d5bb-3b30-4d94-86d0-cbea14735d4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:41.124758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9727d5bb-3b30-4d94-86d0-cbea14735d4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:41.134077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9727d5bb-3b30-4d94-86d0-cbea14735d4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237298 Apr 19 03:49:41.134692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 581/1113] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:40 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:42.153002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7738b7a0-4d82-40ec-907e-8a34f04f0941 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:42.153803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7738b7a0-4d82-40ec-907e-8a34f04f0941 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:42.162238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7738b7a0-4d82-40ec-907e-8a34f04f0941 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:42.162744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7738b7a0-4d82-40ec-907e-8a34f04f0941 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:42.163664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7738b7a0-4d82-40ec-907e-8a34f04f0941 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:42.164075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7738b7a0-4d82-40ec-907e-8a34f04f0941 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:42.592457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7738b7a0-4d82-40ec-907e-8a34f04f0941 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:42.601762 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7738b7a0-4d82-40ec-907e-8a34f04f0941 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.452962 Apr 19 03:49:42.602463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 533/1114] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:42 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:43.620524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f106f5dd-ef31-4fb7-9c6a-e19b589a8ce9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:43.621204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f106f5dd-ef31-4fb7-9c6a-e19b589a8ce9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:43.629064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f106f5dd-ef31-4fb7-9c6a-e19b589a8ce9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:43.629570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f106f5dd-ef31-4fb7-9c6a-e19b589a8ce9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:43.630393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f106f5dd-ef31-4fb7-9c6a-e19b589a8ce9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:43.630881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f106f5dd-ef31-4fb7-9c6a-e19b589a8ce9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:43.845080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f106f5dd-ef31-4fb7-9c6a-e19b589a8ce9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:43.853950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f106f5dd-ef31-4fb7-9c6a-e19b589a8ce9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237441 Apr 19 03:49:43.854483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 582/1115] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:43 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:44.872288 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c93095de-5d9d-4453-b9a6-de2be1c1556b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:44.872968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c93095de-5d9d-4453-b9a6-de2be1c1556b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:44.880807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c93095de-5d9d-4453-b9a6-de2be1c1556b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:44.881319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c93095de-5d9d-4453-b9a6-de2be1c1556b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:44.882145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c93095de-5d9d-4453-b9a6-de2be1c1556b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:44.882723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c93095de-5d9d-4453-b9a6-de2be1c1556b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:45.096335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c93095de-5d9d-4453-b9a6-de2be1c1556b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:45.105807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c93095de-5d9d-4453-b9a6-de2be1c1556b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237598 Apr 19 03:49:45.106422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 534/1116] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:44 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:46.124370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6580452d-95d0-44c4-b6f4-1f4eff08426f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:46.124991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6580452d-95d0-44c4-b6f4-1f4eff08426f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:46.132861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6580452d-95d0-44c4-b6f4-1f4eff08426f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:46.133363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6580452d-95d0-44c4-b6f4-1f4eff08426f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:46.134185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6580452d-95d0-44c4-b6f4-1f4eff08426f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:46.134672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6580452d-95d0-44c4-b6f4-1f4eff08426f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:46.350080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6580452d-95d0-44c4-b6f4-1f4eff08426f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:46.358856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6580452d-95d0-44c4-b6f4-1f4eff08426f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238662 Apr 19 03:49:46.359502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 583/1117] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:46 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:46.768026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:49:46.768186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:49:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:49:47.088025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:49:47.088215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:49:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:49:47.377959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ab22647d-43fb-4bb5-81f7-6d139140b6ac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:47.378731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ab22647d-43fb-4bb5-81f7-6d139140b6ac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:47.387821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab22647d-43fb-4bb5-81f7-6d139140b6ac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:47.388337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab22647d-43fb-4bb5-81f7-6d139140b6ac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:47.389250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab22647d-43fb-4bb5-81f7-6d139140b6ac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:47.389715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab22647d-43fb-4bb5-81f7-6d139140b6ac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:47.600798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ab22647d-43fb-4bb5-81f7-6d139140b6ac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:47.609665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ab22647d-43fb-4bb5-81f7-6d139140b6ac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235827 Apr 19 03:49:47.610275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 535/1118] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:47 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:48.039665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:49:48.039835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:49:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:49:48.628023 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-42715f05-815e-4a22-8e3e-ce917f3ae838 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:48.628695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-42715f05-815e-4a22-8e3e-ce917f3ae838 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:48.637042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42715f05-815e-4a22-8e3e-ce917f3ae838 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:48.637552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42715f05-815e-4a22-8e3e-ce917f3ae838 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:48.638386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42715f05-815e-4a22-8e3e-ce917f3ae838 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:48.638877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42715f05-815e-4a22-8e3e-ce917f3ae838 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:48.849626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-42715f05-815e-4a22-8e3e-ce917f3ae838 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:48.858602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-42715f05-815e-4a22-8e3e-ce917f3ae838 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234676 Apr 19 03:49:48.859234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 584/1119] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:48 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:49.878101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3c32cfbf-3281-4702-8bdd-fdf06ed29684 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:49.878900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3c32cfbf-3281-4702-8bdd-fdf06ed29684 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:49.887389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c32cfbf-3281-4702-8bdd-fdf06ed29684 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:49.887898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c32cfbf-3281-4702-8bdd-fdf06ed29684 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:49.888810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c32cfbf-3281-4702-8bdd-fdf06ed29684 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:49.889323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c32cfbf-3281-4702-8bdd-fdf06ed29684 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:50.098209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3c32cfbf-3281-4702-8bdd-fdf06ed29684 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:50.107192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3c32cfbf-3281-4702-8bdd-fdf06ed29684 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233180 Apr 19 03:49:50.107791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 536/1120] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:49 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:51.125588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1346c899-03f8-4d59-89b3-e4c20d12326f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:51.126250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1346c899-03f8-4d59-89b3-e4c20d12326f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:51.134109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1346c899-03f8-4d59-89b3-e4c20d12326f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:51.134608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1346c899-03f8-4d59-89b3-e4c20d12326f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:51.135471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1346c899-03f8-4d59-89b3-e4c20d12326f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:51.135963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1346c899-03f8-4d59-89b3-e4c20d12326f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:51.350297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1346c899-03f8-4d59-89b3-e4c20d12326f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:51.359252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1346c899-03f8-4d59-89b3-e4c20d12326f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237654 Apr 19 03:49:51.359881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 585/1121] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:51 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:52.378028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b240a709-cf3a-446f-86e6-12a3240b860e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:52.378694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b240a709-cf3a-446f-86e6-12a3240b860e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:52.386975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b240a709-cf3a-446f-86e6-12a3240b860e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:52.387511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b240a709-cf3a-446f-86e6-12a3240b860e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:52.388345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b240a709-cf3a-446f-86e6-12a3240b860e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:52.388836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b240a709-cf3a-446f-86e6-12a3240b860e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:52.605325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b240a709-cf3a-446f-86e6-12a3240b860e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:52.614346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b240a709-cf3a-446f-86e6-12a3240b860e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240379 Apr 19 03:49:52.614955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 537/1122] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:52 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:53.633010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-75296a9f-0d9f-4452-9c6e-5d2f3ca16473 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:53.633806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-75296a9f-0d9f-4452-9c6e-5d2f3ca16473 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:53.641835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75296a9f-0d9f-4452-9c6e-5d2f3ca16473 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:53.642340 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75296a9f-0d9f-4452-9c6e-5d2f3ca16473 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:53.643189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75296a9f-0d9f-4452-9c6e-5d2f3ca16473 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:53.643712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75296a9f-0d9f-4452-9c6e-5d2f3ca16473 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:53.858161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-75296a9f-0d9f-4452-9c6e-5d2f3ca16473 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:53.868266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-75296a9f-0d9f-4452-9c6e-5d2f3ca16473 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239319 Apr 19 03:49:53.869060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 586/1123] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:53 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:54.886527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-889bf598-0be3-4129-b655-035b06bfc3a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:54.887212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-889bf598-0be3-4129-b655-035b06bfc3a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:54.896128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-889bf598-0be3-4129-b655-035b06bfc3a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:54.896653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-889bf598-0be3-4129-b655-035b06bfc3a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:54.897568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-889bf598-0be3-4129-b655-035b06bfc3a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:54.898070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-889bf598-0be3-4129-b655-035b06bfc3a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:55.115760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-889bf598-0be3-4129-b655-035b06bfc3a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:55.124719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-889bf598-0be3-4129-b655-035b06bfc3a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.242241 Apr 19 03:49:55.125340 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 538/1124] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:54 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:56.142211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5fb0e922-b270-4659-a491-4037d9bfa6ea tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:56.142825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5fb0e922-b270-4659-a491-4037d9bfa6ea tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:56.151333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5fb0e922-b270-4659-a491-4037d9bfa6ea tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:56.151842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5fb0e922-b270-4659-a491-4037d9bfa6ea tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:56.152671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5fb0e922-b270-4659-a491-4037d9bfa6ea tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:56.153167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5fb0e922-b270-4659-a491-4037d9bfa6ea tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:56.363482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5fb0e922-b270-4659-a491-4037d9bfa6ea tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:56.373098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5fb0e922-b270-4659-a491-4037d9bfa6ea tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235032 Apr 19 03:49:56.373724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 587/1125] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:56 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:57.391884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-356c58e9-2fbc-479c-88f1-499b4337f996 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:57.392569 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-356c58e9-2fbc-479c-88f1-499b4337f996 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:57.400888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-356c58e9-2fbc-479c-88f1-499b4337f996 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:57.401391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-356c58e9-2fbc-479c-88f1-499b4337f996 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:57.402212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-356c58e9-2fbc-479c-88f1-499b4337f996 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:57.402705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-356c58e9-2fbc-479c-88f1-499b4337f996 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:57.618060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-356c58e9-2fbc-479c-88f1-499b4337f996 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:57.626932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-356c58e9-2fbc-479c-88f1-499b4337f996 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239237 Apr 19 03:49:57.627572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 539/1126] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:57 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:58.646304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0c87dbb9-69d9-4acd-a948-6b3ab2a03b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:58.646970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0c87dbb9-69d9-4acd-a948-6b3ab2a03b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:58.654813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c87dbb9-69d9-4acd-a948-6b3ab2a03b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:58.655378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c87dbb9-69d9-4acd-a948-6b3ab2a03b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:58.656198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c87dbb9-69d9-4acd-a948-6b3ab2a03b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:58.656755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c87dbb9-69d9-4acd-a948-6b3ab2a03b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:58.869939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0c87dbb9-69d9-4acd-a948-6b3ab2a03b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:49:58.878738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0c87dbb9-69d9-4acd-a948-6b3ab2a03b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237237 Apr 19 03:49:58.879870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 588/1127] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:58 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:49:59.897388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-89f899da-17e8-494f-8f41-84d2bde2d982 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:49:59.898059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-89f899da-17e8-494f-8f41-84d2bde2d982 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:49:59.905805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89f899da-17e8-494f-8f41-84d2bde2d982 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:59.906308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89f899da-17e8-494f-8f41-84d2bde2d982 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:49:59.907125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89f899da-17e8-494f-8f41-84d2bde2d982 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:49:59.907631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89f899da-17e8-494f-8f41-84d2bde2d982 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:00.117703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-89f899da-17e8-494f-8f41-84d2bde2d982 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:00.126505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-89f899da-17e8-494f-8f41-84d2bde2d982 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233209 Apr 19 03:50:00.127113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 540/1128] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:49:59 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:01.145159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-449c302b-d5d9-4cc0-b627-da0f38ae6e84 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:01.145778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-449c302b-d5d9-4cc0-b627-da0f38ae6e84 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:01.153697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-449c302b-d5d9-4cc0-b627-da0f38ae6e84 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:01.154205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-449c302b-d5d9-4cc0-b627-da0f38ae6e84 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:01.155043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-449c302b-d5d9-4cc0-b627-da0f38ae6e84 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:01.155589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-449c302b-d5d9-4cc0-b627-da0f38ae6e84 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:01.366687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-449c302b-d5d9-4cc0-b627-da0f38ae6e84 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:01.375635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-449c302b-d5d9-4cc0-b627-da0f38ae6e84 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234792 Apr 19 03:50:01.376255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 589/1129] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:01 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:02.393400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-90f47ad0-1d26-44bd-838a-505951877a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:02.394015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-90f47ad0-1d26-44bd-838a-505951877a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:02.401953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-90f47ad0-1d26-44bd-838a-505951877a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:02.402460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-90f47ad0-1d26-44bd-838a-505951877a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:02.403320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-90f47ad0-1d26-44bd-838a-505951877a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:02.403819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-90f47ad0-1d26-44bd-838a-505951877a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:02.627437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-90f47ad0-1d26-44bd-838a-505951877a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:02.636201 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-90f47ad0-1d26-44bd-838a-505951877a34 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.247190 Apr 19 03:50:02.636822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 541/1130] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:02 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:03.189772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:50:03.189935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:50:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:50:03.654150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c0844c35-901b-46d4-9d46-649b6e5540db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:03.654834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c0844c35-901b-46d4-9d46-649b6e5540db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:03.662661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0844c35-901b-46d4-9d46-649b6e5540db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:03.663182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0844c35-901b-46d4-9d46-649b6e5540db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:03.664045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0844c35-901b-46d4-9d46-649b6e5540db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:03.664535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0844c35-901b-46d4-9d46-649b6e5540db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:03.881444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c0844c35-901b-46d4-9d46-649b6e5540db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:03.890438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c0844c35-901b-46d4-9d46-649b6e5540db tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240395 Apr 19 03:50:03.891167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 590/1131] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:03 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:04.908783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8409d3cb-6530-4e0a-ae8c-4362fb0fde4f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:04.909472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8409d3cb-6530-4e0a-ae8c-4362fb0fde4f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:04.917584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8409d3cb-6530-4e0a-ae8c-4362fb0fde4f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:04.918042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8409d3cb-6530-4e0a-ae8c-4362fb0fde4f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:04.918871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8409d3cb-6530-4e0a-ae8c-4362fb0fde4f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:04.919392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8409d3cb-6530-4e0a-ae8c-4362fb0fde4f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:05.126338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8409d3cb-6530-4e0a-ae8c-4362fb0fde4f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:05.135812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8409d3cb-6530-4e0a-ae8c-4362fb0fde4f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.231122 Apr 19 03:50:05.136430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 542/1132] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:04 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:06.154499 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dd1e88af-3c93-47e0-bb0a-4debb81fc42a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:06.155118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dd1e88af-3c93-47e0-bb0a-4debb81fc42a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:06.163620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd1e88af-3c93-47e0-bb0a-4debb81fc42a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:06.164131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd1e88af-3c93-47e0-bb0a-4debb81fc42a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:06.164955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd1e88af-3c93-47e0-bb0a-4debb81fc42a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:06.165447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd1e88af-3c93-47e0-bb0a-4debb81fc42a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:06.381180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dd1e88af-3c93-47e0-bb0a-4debb81fc42a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:06.390139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dd1e88af-3c93-47e0-bb0a-4debb81fc42a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239726 Apr 19 03:50:06.390741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 591/1133] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:06 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:07.409673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9103f0d1-8ff8-4440-a0d2-b0b0d7d28a2b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:07.410918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9103f0d1-8ff8-4440-a0d2-b0b0d7d28a2b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:07.418734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9103f0d1-8ff8-4440-a0d2-b0b0d7d28a2b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:07.419272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9103f0d1-8ff8-4440-a0d2-b0b0d7d28a2b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:07.420100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9103f0d1-8ff8-4440-a0d2-b0b0d7d28a2b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:07.420591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9103f0d1-8ff8-4440-a0d2-b0b0d7d28a2b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:07.639496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9103f0d1-8ff8-4440-a0d2-b0b0d7d28a2b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:07.649134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9103f0d1-8ff8-4440-a0d2-b0b0d7d28a2b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.243557 Apr 19 03:50:07.649812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 543/1134] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:07 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:08.667767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9fee15b0-c0c4-4272-8f58-2be03e1f3fff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:08.668432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9fee15b0-c0c4-4272-8f58-2be03e1f3fff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:08.676930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fee15b0-c0c4-4272-8f58-2be03e1f3fff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:08.677432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fee15b0-c0c4-4272-8f58-2be03e1f3fff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:08.678250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fee15b0-c0c4-4272-8f58-2be03e1f3fff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:08.678736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fee15b0-c0c4-4272-8f58-2be03e1f3fff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:08.887114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9fee15b0-c0c4-4272-8f58-2be03e1f3fff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:08.895861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9fee15b0-c0c4-4272-8f58-2be03e1f3fff tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.232340 Apr 19 03:50:08.896478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 592/1135] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:08 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:09.914020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f1c4ca3e-259c-40e0-8796-75aa5651b3f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:09.914629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f1c4ca3e-259c-40e0-8796-75aa5651b3f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:09.922399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f1c4ca3e-259c-40e0-8796-75aa5651b3f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:09.922899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f1c4ca3e-259c-40e0-8796-75aa5651b3f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:09.923751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f1c4ca3e-259c-40e0-8796-75aa5651b3f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:09.924235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f1c4ca3e-259c-40e0-8796-75aa5651b3f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:10.135442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f1c4ca3e-259c-40e0-8796-75aa5651b3f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:10.144274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f1c4ca3e-259c-40e0-8796-75aa5651b3f4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234377 Apr 19 03:50:10.144883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 544/1136] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:09 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:11.162561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d1d35718-3180-4789-bfc4-dcaf6f7dbc9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:11.163179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d1d35718-3180-4789-bfc4-dcaf6f7dbc9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:11.171206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1d35718-3180-4789-bfc4-dcaf6f7dbc9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:11.171687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1d35718-3180-4789-bfc4-dcaf6f7dbc9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:11.172513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1d35718-3180-4789-bfc4-dcaf6f7dbc9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:11.173004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d1d35718-3180-4789-bfc4-dcaf6f7dbc9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:11.389024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d1d35718-3180-4789-bfc4-dcaf6f7dbc9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:11.398115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d1d35718-3180-4789-bfc4-dcaf6f7dbc9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239811 Apr 19 03:50:11.398727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 593/1137] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:11 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:12.416437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-636a1448-b559-4bda-996f-40b9b4835e67 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:12.417118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-636a1448-b559-4bda-996f-40b9b4835e67 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:12.424924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-636a1448-b559-4bda-996f-40b9b4835e67 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:12.425431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-636a1448-b559-4bda-996f-40b9b4835e67 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:12.426264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-636a1448-b559-4bda-996f-40b9b4835e67 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:12.426756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-636a1448-b559-4bda-996f-40b9b4835e67 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:12.643320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-636a1448-b559-4bda-996f-40b9b4835e67 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:12.654206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-636a1448-b559-4bda-996f-40b9b4835e67 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.241987 Apr 19 03:50:12.654827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 545/1138] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:12 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:13.672415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c6fd67a0-6b7c-4dbf-9a2e-996e2be42ab3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:13.673082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c6fd67a0-6b7c-4dbf-9a2e-996e2be42ab3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:13.680951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c6fd67a0-6b7c-4dbf-9a2e-996e2be42ab3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:13.681450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c6fd67a0-6b7c-4dbf-9a2e-996e2be42ab3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:13.682275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c6fd67a0-6b7c-4dbf-9a2e-996e2be42ab3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:13.682760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c6fd67a0-6b7c-4dbf-9a2e-996e2be42ab3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:13.900793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c6fd67a0-6b7c-4dbf-9a2e-996e2be42ab3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:13.910002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c6fd67a0-6b7c-4dbf-9a2e-996e2be42ab3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.241624 Apr 19 03:50:13.910629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 594/1139] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:13 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:14.929058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1dd2c9bc-be92-42cd-b6d1-e877be02c9ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:14.929724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1dd2c9bc-be92-42cd-b6d1-e877be02c9ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:14.937532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1dd2c9bc-be92-42cd-b6d1-e877be02c9ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:14.938029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1dd2c9bc-be92-42cd-b6d1-e877be02c9ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:14.938852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1dd2c9bc-be92-42cd-b6d1-e877be02c9ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:14.939363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1dd2c9bc-be92-42cd-b6d1-e877be02c9ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:15.154475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1dd2c9bc-be92-42cd-b6d1-e877be02c9ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:15.163623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1dd2c9bc-be92-42cd-b6d1-e877be02c9ed tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239010 Apr 19 03:50:15.164285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 546/1140] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:14 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:16.183412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-aa20c7e4-260b-4869-a26d-7c275c751858 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:16.184086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-aa20c7e4-260b-4869-a26d-7c275c751858 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:16.192615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aa20c7e4-260b-4869-a26d-7c275c751858 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:16.193120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aa20c7e4-260b-4869-a26d-7c275c751858 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:16.193949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aa20c7e4-260b-4869-a26d-7c275c751858 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:16.194440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aa20c7e4-260b-4869-a26d-7c275c751858 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:16.408994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-aa20c7e4-260b-4869-a26d-7c275c751858 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:16.417882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-aa20c7e4-260b-4869-a26d-7c275c751858 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238605 Apr 19 03:50:16.418512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 595/1141] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:16 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:17.436867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-82b17945-ee90-45c8-9837-3488a882f397 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:17.437539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-82b17945-ee90-45c8-9837-3488a882f397 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:17.445406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82b17945-ee90-45c8-9837-3488a882f397 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:17.445910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82b17945-ee90-45c8-9837-3488a882f397 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:17.446743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82b17945-ee90-45c8-9837-3488a882f397 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:17.447236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82b17945-ee90-45c8-9837-3488a882f397 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:17.662658 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-82b17945-ee90-45c8-9837-3488a882f397 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:17.671701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-82b17945-ee90-45c8-9837-3488a882f397 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238866 Apr 19 03:50:17.672312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 547/1142] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:17 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:18.690018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-909dfbad-6e08-4fc5-ac80-3eda2cfb3e14 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:18.690688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-909dfbad-6e08-4fc5-ac80-3eda2cfb3e14 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:18.698569 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-909dfbad-6e08-4fc5-ac80-3eda2cfb3e14 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:18.699076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-909dfbad-6e08-4fc5-ac80-3eda2cfb3e14 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:18.699954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-909dfbad-6e08-4fc5-ac80-3eda2cfb3e14 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:18.700448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-909dfbad-6e08-4fc5-ac80-3eda2cfb3e14 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:18.914477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-909dfbad-6e08-4fc5-ac80-3eda2cfb3e14 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:18.923341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-909dfbad-6e08-4fc5-ac80-3eda2cfb3e14 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237397 Apr 19 03:50:18.923960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 596/1143] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:18 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:19.941641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-444601ec-378f-4492-b6a3-1432639237a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:19.942311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-444601ec-378f-4492-b6a3-1432639237a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:19.950182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-444601ec-378f-4492-b6a3-1432639237a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:19.950697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-444601ec-378f-4492-b6a3-1432639237a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:19.951551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-444601ec-378f-4492-b6a3-1432639237a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:19.952037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-444601ec-378f-4492-b6a3-1432639237a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:20.158346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-444601ec-378f-4492-b6a3-1432639237a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:20.167660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-444601ec-378f-4492-b6a3-1432639237a0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.230200 Apr 19 03:50:20.168272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 548/1144] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:19 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:21.186974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c170bbcd-77cc-4a89-b1c9-c5a715634f47 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:21.187670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c170bbcd-77cc-4a89-b1c9-c5a715634f47 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:21.196215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c170bbcd-77cc-4a89-b1c9-c5a715634f47 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:21.196721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c170bbcd-77cc-4a89-b1c9-c5a715634f47 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:21.197551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c170bbcd-77cc-4a89-b1c9-c5a715634f47 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:21.198040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c170bbcd-77cc-4a89-b1c9-c5a715634f47 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:21.413104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c170bbcd-77cc-4a89-b1c9-c5a715634f47 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:21.423200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c170bbcd-77cc-4a89-b1c9-c5a715634f47 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240271 Apr 19 03:50:21.423913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 597/1145] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:21 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:22.444425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bacdebbe-bc6c-490b-a51d-3703faed2251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:22.445104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bacdebbe-bc6c-490b-a51d-3703faed2251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:22.453296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bacdebbe-bc6c-490b-a51d-3703faed2251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:22.453806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bacdebbe-bc6c-490b-a51d-3703faed2251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:22.454656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bacdebbe-bc6c-490b-a51d-3703faed2251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:22.455181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bacdebbe-bc6c-490b-a51d-3703faed2251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:22.677198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bacdebbe-bc6c-490b-a51d-3703faed2251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:22.686137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bacdebbe-bc6c-490b-a51d-3703faed2251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.246389 Apr 19 03:50:22.686759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 549/1146] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:22 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:23.705153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1f108d00-c66f-4302-b529-e345ff565643 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:23.705822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1f108d00-c66f-4302-b529-e345ff565643 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:23.714252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f108d00-c66f-4302-b529-e345ff565643 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:23.714754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f108d00-c66f-4302-b529-e345ff565643 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:23.715612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f108d00-c66f-4302-b529-e345ff565643 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:23.716095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f108d00-c66f-4302-b529-e345ff565643 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:23.930571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1f108d00-c66f-4302-b529-e345ff565643 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:23.939636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1f108d00-c66f-4302-b529-e345ff565643 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238562 Apr 19 03:50:23.940264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 598/1147] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:23 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:24.959438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-af088570-d832-40e4-ae2a-6be3e7a4be6b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:24.960088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-af088570-d832-40e4-ae2a-6be3e7a4be6b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:24.968037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af088570-d832-40e4-ae2a-6be3e7a4be6b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:24.968542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af088570-d832-40e4-ae2a-6be3e7a4be6b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:24.969371 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af088570-d832-40e4-ae2a-6be3e7a4be6b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:24.969858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af088570-d832-40e4-ae2a-6be3e7a4be6b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:25.179482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-af088570-d832-40e4-ae2a-6be3e7a4be6b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:25.188520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-af088570-d832-40e4-ae2a-6be3e7a4be6b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233923 Apr 19 03:50:25.189152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 550/1148] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:24 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:26.207128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bb4331d9-48cf-4f90-a814-cc611d189c4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:26.207820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bb4331d9-48cf-4f90-a814-cc611d189c4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:26.215596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb4331d9-48cf-4f90-a814-cc611d189c4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:26.216103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb4331d9-48cf-4f90-a814-cc611d189c4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:26.216934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb4331d9-48cf-4f90-a814-cc611d189c4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:26.217410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb4331d9-48cf-4f90-a814-cc611d189c4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:26.425105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bb4331d9-48cf-4f90-a814-cc611d189c4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:26.433881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bb4331d9-48cf-4f90-a814-cc611d189c4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.231510 Apr 19 03:50:26.434542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 599/1149] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:26 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:27.451843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3aedbf5c-00ca-4f06-b517-9871dedc8742 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:27.452509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3aedbf5c-00ca-4f06-b517-9871dedc8742 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:27.460252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3aedbf5c-00ca-4f06-b517-9871dedc8742 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:27.460750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3aedbf5c-00ca-4f06-b517-9871dedc8742 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:27.461570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3aedbf5c-00ca-4f06-b517-9871dedc8742 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:27.462056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3aedbf5c-00ca-4f06-b517-9871dedc8742 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:27.676015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3aedbf5c-00ca-4f06-b517-9871dedc8742 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:27.684853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3aedbf5c-00ca-4f06-b517-9871dedc8742 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237058 Apr 19 03:50:27.685470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 551/1150] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:27 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:28.702831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d56c9735-9437-4930-a3a0-63e730a2a1ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:28.703537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d56c9735-9437-4930-a3a0-63e730a2a1ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:28.711445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d56c9735-9437-4930-a3a0-63e730a2a1ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:28.711951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d56c9735-9437-4930-a3a0-63e730a2a1ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:28.712778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d56c9735-9437-4930-a3a0-63e730a2a1ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:28.713268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d56c9735-9437-4930-a3a0-63e730a2a1ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:29.066777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d56c9735-9437-4930-a3a0-63e730a2a1ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:29.075785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d56c9735-9437-4930-a3a0-63e730a2a1ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.377086 Apr 19 03:50:29.076399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 600/1151] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:28 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:30.094029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b5c4a2ff-d112-437a-941e-6814f696a7fa tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:30.094617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b5c4a2ff-d112-437a-941e-6814f696a7fa tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:30.103075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b5c4a2ff-d112-437a-941e-6814f696a7fa tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:30.103627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b5c4a2ff-d112-437a-941e-6814f696a7fa tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:30.104490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b5c4a2ff-d112-437a-941e-6814f696a7fa tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:30.104986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b5c4a2ff-d112-437a-941e-6814f696a7fa tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:30.341273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b5c4a2ff-d112-437a-941e-6814f696a7fa tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:30.346053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b5c4a2ff-d112-437a-941e-6814f696a7fa tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.256245 Apr 19 03:50:30.347309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 552/1152] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:30 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:31.364408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ec606182-4671-4da7-ac89-ffd12f57ad29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:31.365127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ec606182-4671-4da7-ac89-ffd12f57ad29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:31.373857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ec606182-4671-4da7-ac89-ffd12f57ad29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:31.374365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ec606182-4671-4da7-ac89-ffd12f57ad29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:31.375221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ec606182-4671-4da7-ac89-ffd12f57ad29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:31.375710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ec606182-4671-4da7-ac89-ffd12f57ad29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:31.594039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ec606182-4671-4da7-ac89-ffd12f57ad29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:31.603391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ec606182-4671-4da7-ac89-ffd12f57ad29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.242989 Apr 19 03:50:31.604007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 601/1153] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:31 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:32.623505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bf51f80e-f51f-40db-a76e-cca356803675 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:32.624190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bf51f80e-f51f-40db-a76e-cca356803675 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:32.632214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf51f80e-f51f-40db-a76e-cca356803675 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:32.632729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf51f80e-f51f-40db-a76e-cca356803675 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:32.633579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf51f80e-f51f-40db-a76e-cca356803675 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:32.634077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf51f80e-f51f-40db-a76e-cca356803675 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:32.847508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bf51f80e-f51f-40db-a76e-cca356803675 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:32.856420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bf51f80e-f51f-40db-a76e-cca356803675 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237850 Apr 19 03:50:32.857039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 553/1154] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:32 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:33.874930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b5c72dbe-44a2-4517-857c-10f6ad046915 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:33.875637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b5c72dbe-44a2-4517-857c-10f6ad046915 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:33.885960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b5c72dbe-44a2-4517-857c-10f6ad046915 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:33.885960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b5c72dbe-44a2-4517-857c-10f6ad046915 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:33.885960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b5c72dbe-44a2-4517-857c-10f6ad046915 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:33.885960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b5c72dbe-44a2-4517-857c-10f6ad046915 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:34.094222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b5c72dbe-44a2-4517-857c-10f6ad046915 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:34.103530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b5c72dbe-44a2-4517-857c-10f6ad046915 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.232636 Apr 19 03:50:34.104142 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 602/1155] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:33 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:35.122741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-490e6210-5e17-43ef-a61a-e2a98a9bd2cc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:35.123405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-490e6210-5e17-43ef-a61a-e2a98a9bd2cc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:35.131665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-490e6210-5e17-43ef-a61a-e2a98a9bd2cc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:35.132165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-490e6210-5e17-43ef-a61a-e2a98a9bd2cc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:35.132985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-490e6210-5e17-43ef-a61a-e2a98a9bd2cc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:35.133468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-490e6210-5e17-43ef-a61a-e2a98a9bd2cc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:35.345037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-490e6210-5e17-43ef-a61a-e2a98a9bd2cc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:35.353874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-490e6210-5e17-43ef-a61a-e2a98a9bd2cc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235279 Apr 19 03:50:35.354499 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 554/1156] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:35 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:36.372724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3c165077-4c63-4541-ad14-48579e1204d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:36.373390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3c165077-4c63-4541-ad14-48579e1204d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:36.381653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c165077-4c63-4541-ad14-48579e1204d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:36.382154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c165077-4c63-4541-ad14-48579e1204d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:36.382971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c165077-4c63-4541-ad14-48579e1204d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:36.383479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c165077-4c63-4541-ad14-48579e1204d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:36.600115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3c165077-4c63-4541-ad14-48579e1204d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:36.609120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3c165077-4c63-4541-ad14-48579e1204d5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240453 Apr 19 03:50:36.609724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 603/1157] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:36 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:37.627251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8a576693-ffd6-45c2-a480-be248235322a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:37.627975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8a576693-ffd6-45c2-a480-be248235322a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:37.635932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a576693-ffd6-45c2-a480-be248235322a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:37.636441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a576693-ffd6-45c2-a480-be248235322a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:37.637267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a576693-ffd6-45c2-a480-be248235322a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:37.637758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8a576693-ffd6-45c2-a480-be248235322a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:37.850007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8a576693-ffd6-45c2-a480-be248235322a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:37.858909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8a576693-ffd6-45c2-a480-be248235322a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235779 Apr 19 03:50:37.859548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 555/1158] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:37 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:38.876678 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-564f5317-483a-4709-986c-e231cfdbcad6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:38.877277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-564f5317-483a-4709-986c-e231cfdbcad6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:38.885115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-564f5317-483a-4709-986c-e231cfdbcad6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:38.885623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-564f5317-483a-4709-986c-e231cfdbcad6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:38.886448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-564f5317-483a-4709-986c-e231cfdbcad6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:38.886935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-564f5317-483a-4709-986c-e231cfdbcad6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:39.097840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-564f5317-483a-4709-986c-e231cfdbcad6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:39.106689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-564f5317-483a-4709-986c-e231cfdbcad6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234115 Apr 19 03:50:39.107511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 604/1159] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:38 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:40.125108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-44962163-cd2f-46f5-8b01-9aea7ae01c41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:40.125785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-44962163-cd2f-46f5-8b01-9aea7ae01c41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:40.133764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44962163-cd2f-46f5-8b01-9aea7ae01c41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:40.134265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44962163-cd2f-46f5-8b01-9aea7ae01c41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:40.135091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44962163-cd2f-46f5-8b01-9aea7ae01c41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:40.135607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44962163-cd2f-46f5-8b01-9aea7ae01c41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:40.353368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-44962163-cd2f-46f5-8b01-9aea7ae01c41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:40.362967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-44962163-cd2f-46f5-8b01-9aea7ae01c41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.241275 Apr 19 03:50:40.363618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 556/1160] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:40 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:41.382986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-db2a26c3-8f7b-432f-bbb0-3d659bfb57c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:41.383845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-db2a26c3-8f7b-432f-bbb0-3d659bfb57c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:41.395364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db2a26c3-8f7b-432f-bbb0-3d659bfb57c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:41.395872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db2a26c3-8f7b-432f-bbb0-3d659bfb57c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:41.396715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db2a26c3-8f7b-432f-bbb0-3d659bfb57c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:41.397204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-db2a26c3-8f7b-432f-bbb0-3d659bfb57c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:41.617694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-db2a26c3-8f7b-432f-bbb0-3d659bfb57c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:41.626715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-db2a26c3-8f7b-432f-bbb0-3d659bfb57c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.249447 Apr 19 03:50:41.627369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 605/1161] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:41 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:42.645577 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2cfdcb16-30cb-4b84-8813-fe5cd4e282fd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:42.646253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2cfdcb16-30cb-4b84-8813-fe5cd4e282fd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:42.654226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cfdcb16-30cb-4b84-8813-fe5cd4e282fd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:42.654738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cfdcb16-30cb-4b84-8813-fe5cd4e282fd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:42.655612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cfdcb16-30cb-4b84-8813-fe5cd4e282fd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:42.656107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cfdcb16-30cb-4b84-8813-fe5cd4e282fd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:42.866609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2cfdcb16-30cb-4b84-8813-fe5cd4e282fd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:42.875489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2cfdcb16-30cb-4b84-8813-fe5cd4e282fd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234668 Apr 19 03:50:42.876109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 557/1162] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:42 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:43.894807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-da2ea8df-0a81-45ed-9746-afa596b3c1de tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:43.895504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-da2ea8df-0a81-45ed-9746-afa596b3c1de tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:43.903309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da2ea8df-0a81-45ed-9746-afa596b3c1de tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:43.903763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da2ea8df-0a81-45ed-9746-afa596b3c1de tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:43.904589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da2ea8df-0a81-45ed-9746-afa596b3c1de tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:43.905077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da2ea8df-0a81-45ed-9746-afa596b3c1de tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:44.113134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-da2ea8df-0a81-45ed-9746-afa596b3c1de tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:44.122222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-da2ea8df-0a81-45ed-9746-afa596b3c1de tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.232158 Apr 19 03:50:44.122831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 606/1163] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:43 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:45.141027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f542c74f-3a6d-49e6-9cdd-a925da85c264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:45.141679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f542c74f-3a6d-49e6-9cdd-a925da85c264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:45.149981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f542c74f-3a6d-49e6-9cdd-a925da85c264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:45.150485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f542c74f-3a6d-49e6-9cdd-a925da85c264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:45.151374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f542c74f-3a6d-49e6-9cdd-a925da85c264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:45.151862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f542c74f-3a6d-49e6-9cdd-a925da85c264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:45.362524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f542c74f-3a6d-49e6-9cdd-a925da85c264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:45.371737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f542c74f-3a6d-49e6-9cdd-a925da85c264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234961 Apr 19 03:50:45.372351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 558/1164] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:45 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:46.390597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2a913e55-7611-4972-bc44-edb6deb41597 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:46.391294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2a913e55-7611-4972-bc44-edb6deb41597 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:46.399230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a913e55-7611-4972-bc44-edb6deb41597 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:46.399747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a913e55-7611-4972-bc44-edb6deb41597 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:46.400579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a913e55-7611-4972-bc44-edb6deb41597 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:46.401077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a913e55-7611-4972-bc44-edb6deb41597 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:46.616089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2a913e55-7611-4972-bc44-edb6deb41597 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:46.625058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2a913e55-7611-4972-bc44-edb6deb41597 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238498 Apr 19 03:50:46.625656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 607/1165] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:46 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:47.643534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-74618a12-c016-4cfb-b1ee-742d12510d2e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:47.644244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-74618a12-c016-4cfb-b1ee-742d12510d2e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:47.652150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-74618a12-c016-4cfb-b1ee-742d12510d2e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:47.652657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-74618a12-c016-4cfb-b1ee-742d12510d2e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:47.653481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-74618a12-c016-4cfb-b1ee-742d12510d2e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:47.653971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-74618a12-c016-4cfb-b1ee-742d12510d2e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:47.867759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-74618a12-c016-4cfb-b1ee-742d12510d2e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:47.876861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-74618a12-c016-4cfb-b1ee-742d12510d2e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237545 Apr 19 03:50:47.877509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 559/1166] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:47 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:48.022885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-38027c1c-4e75-40c2-bbb0-9c6f4cd05c4c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:48.023454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-38027c1c-4e75-40c2-bbb0-9c6f4cd05c4c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:48.031227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38027c1c-4e75-40c2-bbb0-9c6f4cd05c4c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:48.031733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38027c1c-4e75-40c2-bbb0-9c6f4cd05c4c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:48.032554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38027c1c-4e75-40c2-bbb0-9c6f4cd05c4c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:48.033041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38027c1c-4e75-40c2-bbb0-9c6f4cd05c4c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:48.281635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-38027c1c-4e75-40c2-bbb0-9c6f4cd05c4c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lazy-loading 'services' on Instance uuid 399e1abb-7255-4f6f-b038-2fbfe20f7b3e {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:50:48.489976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-38027c1c-4e75-40c2-bbb0-9c6f4cd05c4c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "DELETE /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e/os-volume_attachments/f7015673-9aa6-4d92-988b-b87160196b92" status: 202 len: 0 microversion: 2.1 time: 0.471499 Apr 19 03:50:48.490854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 608/1167] 10.222.0.25 () {58 vars in 1406 bytes} [Mon Apr 19 03:50:48 2021] DELETE /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e/os-volume_attachments/f7015673-9aa6-4d92-988b-b87160196b92 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:50:48.895720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d2dea2be-05e3-43da-b6de-f3e4edf36d40 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:48.896398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d2dea2be-05e3-43da-b6de-f3e4edf36d40 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:48.904269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2dea2be-05e3-43da-b6de-f3e4edf36d40 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:48.904771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2dea2be-05e3-43da-b6de-f3e4edf36d40 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:48.905618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2dea2be-05e3-43da-b6de-f3e4edf36d40 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:48.906059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2dea2be-05e3-43da-b6de-f3e4edf36d40 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:49.119406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d2dea2be-05e3-43da-b6de-f3e4edf36d40 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:49.128568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d2dea2be-05e3-43da-b6de-f3e4edf36d40 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237067 Apr 19 03:50:49.129271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 560/1168] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:48 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:50.147915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-36bd579d-d0ed-4e4e-afce-5e756fb9cda6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:50.148693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-36bd579d-d0ed-4e4e-afce-5e756fb9cda6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:50.156668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36bd579d-d0ed-4e4e-afce-5e756fb9cda6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:50.157174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36bd579d-d0ed-4e4e-afce-5e756fb9cda6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:50.158008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36bd579d-d0ed-4e4e-afce-5e756fb9cda6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:50.158499 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36bd579d-d0ed-4e4e-afce-5e756fb9cda6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:50.376308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-36bd579d-d0ed-4e4e-afce-5e756fb9cda6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:50.385813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-36bd579d-d0ed-4e4e-afce-5e756fb9cda6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.242948 Apr 19 03:50:50.386430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 609/1169] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:50 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:51.404300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a1ff5eb4-bb65-4886-8f54-fbd2ab6a237d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:51.404878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a1ff5eb4-bb65-4886-8f54-fbd2ab6a237d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:51.412792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1ff5eb4-bb65-4886-8f54-fbd2ab6a237d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:51.413291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1ff5eb4-bb65-4886-8f54-fbd2ab6a237d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:51.414120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1ff5eb4-bb65-4886-8f54-fbd2ab6a237d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:51.414600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1ff5eb4-bb65-4886-8f54-fbd2ab6a237d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:51.773231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a1ff5eb4-bb65-4886-8f54-fbd2ab6a237d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:51.782102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a1ff5eb4-bb65-4886-8f54-fbd2ab6a237d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.382059 Apr 19 03:50:51.782719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 561/1170] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:51 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:52.800102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-75323c93-2c98-4865-b9af-acbe770ec88f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:52.800707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-75323c93-2c98-4865-b9af-acbe770ec88f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:52.808598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75323c93-2c98-4865-b9af-acbe770ec88f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:52.809100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75323c93-2c98-4865-b9af-acbe770ec88f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:52.809918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75323c93-2c98-4865-b9af-acbe770ec88f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:52.810402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75323c93-2c98-4865-b9af-acbe770ec88f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:53.021813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-75323c93-2c98-4865-b9af-acbe770ec88f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:53.030743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-75323c93-2c98-4865-b9af-acbe770ec88f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234926 Apr 19 03:50:53.031369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 610/1171] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:52 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:54.048875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-368953d0-e14c-4485-bf01-ea22fd0ccb24 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:54.049762 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-368953d0-e14c-4485-bf01-ea22fd0ccb24 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:54.057689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-368953d0-e14c-4485-bf01-ea22fd0ccb24 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:54.058201 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-368953d0-e14c-4485-bf01-ea22fd0ccb24 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:54.059034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-368953d0-e14c-4485-bf01-ea22fd0ccb24 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:54.059556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-368953d0-e14c-4485-bf01-ea22fd0ccb24 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:54.272880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-368953d0-e14c-4485-bf01-ea22fd0ccb24 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:54.281926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-368953d0-e14c-4485-bf01-ea22fd0ccb24 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.237149 Apr 19 03:50:54.282534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 562/1172] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:54 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:55.300890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d906b8c8-fa8d-4725-b9af-1e50f3cd2aac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:55.301566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d906b8c8-fa8d-4725-b9af-1e50f3cd2aac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:55.309401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d906b8c8-fa8d-4725-b9af-1e50f3cd2aac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:55.309917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d906b8c8-fa8d-4725-b9af-1e50f3cd2aac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:55.310752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d906b8c8-fa8d-4725-b9af-1e50f3cd2aac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:55.311271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d906b8c8-fa8d-4725-b9af-1e50f3cd2aac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:55.521950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d906b8c8-fa8d-4725-b9af-1e50f3cd2aac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:55.531018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d906b8c8-fa8d-4725-b9af-1e50f3cd2aac tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.234874 Apr 19 03:50:55.531663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 611/1173] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:55 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:56.550685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-eaed6446-563d-4ce0-84b4-3d74cdae90c3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:56.551329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-eaed6446-563d-4ce0-84b4-3d74cdae90c3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:56.559377 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaed6446-563d-4ce0-84b4-3d74cdae90c3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:56.559888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaed6446-563d-4ce0-84b4-3d74cdae90c3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:56.560724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaed6446-563d-4ce0-84b4-3d74cdae90c3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:56.561218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaed6446-563d-4ce0-84b4-3d74cdae90c3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:56.777169 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-eaed6446-563d-4ce0-84b4-3d74cdae90c3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:56.786565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-eaed6446-563d-4ce0-84b4-3d74cdae90c3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240715 Apr 19 03:50:56.787209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 563/1174] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:56 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:57.805515 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-27b4c5ef-5b2c-4a44-93df-c54733b1911b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:57.806423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-27b4c5ef-5b2c-4a44-93df-c54733b1911b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:57.819070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27b4c5ef-5b2c-4a44-93df-c54733b1911b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:57.819070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27b4c5ef-5b2c-4a44-93df-c54733b1911b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:57.819070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27b4c5ef-5b2c-4a44-93df-c54733b1911b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:57.819070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27b4c5ef-5b2c-4a44-93df-c54733b1911b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:58.028705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-27b4c5ef-5b2c-4a44-93df-c54733b1911b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:58.038233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-27b4c5ef-5b2c-4a44-93df-c54733b1911b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236931 Apr 19 03:50:58.038848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 612/1175] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:57 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:50:59.056349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-69a911a6-907d-4121-8185-8eb97aef5c51 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:50:59.057018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-69a911a6-907d-4121-8185-8eb97aef5c51 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:50:59.065228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-69a911a6-907d-4121-8185-8eb97aef5c51 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:59.065731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-69a911a6-907d-4121-8185-8eb97aef5c51 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:59.066555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-69a911a6-907d-4121-8185-8eb97aef5c51 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:50:59.067043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-69a911a6-907d-4121-8185-8eb97aef5c51 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:50:59.281541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-69a911a6-907d-4121-8185-8eb97aef5c51 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:50:59.290406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-69a911a6-907d-4121-8185-8eb97aef5c51 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238291 Apr 19 03:50:59.291016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 564/1176] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:50:59 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:00.309232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-60d8740c-d51f-4451-80c4-34566d2038d3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:00.309901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-60d8740c-d51f-4451-80c4-34566d2038d3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:00.318217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60d8740c-d51f-4451-80c4-34566d2038d3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:00.318724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60d8740c-d51f-4451-80c4-34566d2038d3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:00.319609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60d8740c-d51f-4451-80c4-34566d2038d3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:00.320105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-60d8740c-d51f-4451-80c4-34566d2038d3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:00.531681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-60d8740c-d51f-4451-80c4-34566d2038d3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:00.540524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-60d8740c-d51f-4451-80c4-34566d2038d3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.235497 Apr 19 03:51:00.541145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 613/1177] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:00 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:01.558415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f9b2733a-109f-48b6-b23f-ef1df8d3ae94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:01.559173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f9b2733a-109f-48b6-b23f-ef1df8d3ae94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:01.567060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9b2733a-109f-48b6-b23f-ef1df8d3ae94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:01.567594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9b2733a-109f-48b6-b23f-ef1df8d3ae94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:01.568423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9b2733a-109f-48b6-b23f-ef1df8d3ae94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:01.568915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9b2733a-109f-48b6-b23f-ef1df8d3ae94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:01.777791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f9b2733a-109f-48b6-b23f-ef1df8d3ae94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:01.787373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f9b2733a-109f-48b6-b23f-ef1df8d3ae94 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.233284 Apr 19 03:51:01.787988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 565/1178] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:01 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:02.806356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-05bc7a4a-f19b-46c7-a86e-c640aa054049 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:02.807019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-05bc7a4a-f19b-46c7-a86e-c640aa054049 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:02.814788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05bc7a4a-f19b-46c7-a86e-c640aa054049 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:02.815319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05bc7a4a-f19b-46c7-a86e-c640aa054049 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:02.816141 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05bc7a4a-f19b-46c7-a86e-c640aa054049 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:02.816621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05bc7a4a-f19b-46c7-a86e-c640aa054049 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:03.029443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-05bc7a4a-f19b-46c7-a86e-c640aa054049 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:03.039040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-05bc7a4a-f19b-46c7-a86e-c640aa054049 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236810 Apr 19 03:51:03.039705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 614/1179] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:02 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:04.056995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cf78c394-39a9-4280-bd21-09ffba001332 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:04.057662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cf78c394-39a9-4280-bd21-09ffba001332 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:04.065529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf78c394-39a9-4280-bd21-09ffba001332 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:04.066033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf78c394-39a9-4280-bd21-09ffba001332 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:04.066861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf78c394-39a9-4280-bd21-09ffba001332 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:04.067434 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf78c394-39a9-4280-bd21-09ffba001332 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:04.280048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cf78c394-39a9-4280-bd21-09ffba001332 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:04.289415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cf78c394-39a9-4280-bd21-09ffba001332 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.236436 Apr 19 03:51:04.290030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 566/1180] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:04 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:05.308477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-acff4c08-a676-423b-acf9-c8b0030cc0f3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:05.309150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-acff4c08-a676-423b-acf9-c8b0030cc0f3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:05.317617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-acff4c08-a676-423b-acf9-c8b0030cc0f3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:05.318127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-acff4c08-a676-423b-acf9-c8b0030cc0f3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:05.318956 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-acff4c08-a676-423b-acf9-c8b0030cc0f3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:05.319476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-acff4c08-a676-423b-acf9-c8b0030cc0f3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:05.534110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-acff4c08-a676-423b-acf9-c8b0030cc0f3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:05.543537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-acff4c08-a676-423b-acf9-c8b0030cc0f3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239049 Apr 19 03:51:05.544330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 615/1181] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:05 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:06.562332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0324966e-1933-40c1-a80a-449d71309814 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:06.563016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0324966e-1933-40c1-a80a-449d71309814 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:06.571506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0324966e-1933-40c1-a80a-449d71309814 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:06.572022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0324966e-1933-40c1-a80a-449d71309814 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:06.572865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0324966e-1933-40c1-a80a-449d71309814 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:06.573361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0324966e-1933-40c1-a80a-449d71309814 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:06.791617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0324966e-1933-40c1-a80a-449d71309814 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:06.801051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0324966e-1933-40c1-a80a-449d71309814 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.242819 Apr 19 03:51:06.801671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 567/1182] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:06 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:07.819859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c1f6f90e-05a9-44af-833a-5133ecc10f7a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:07.820537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c1f6f90e-05a9-44af-833a-5133ecc10f7a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:07.828533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1f6f90e-05a9-44af-833a-5133ecc10f7a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:07.829014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1f6f90e-05a9-44af-833a-5133ecc10f7a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:07.829723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1f6f90e-05a9-44af-833a-5133ecc10f7a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:07.830766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1f6f90e-05a9-44af-833a-5133ecc10f7a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:08.051878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c1f6f90e-05a9-44af-833a-5133ecc10f7a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:08.060628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c1f6f90e-05a9-44af-833a-5133ecc10f7a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.244863 Apr 19 03:51:08.061279 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 616/1183] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:07 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:09.079909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-82971270-d193-4147-b2b4-56a6b31d9a55 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:09.081129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-82971270-d193-4147-b2b4-56a6b31d9a55 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:09.088918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82971270-d193-4147-b2b4-56a6b31d9a55 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:09.089420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82971270-d193-4147-b2b4-56a6b31d9a55 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:09.090249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82971270-d193-4147-b2b4-56a6b31d9a55 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:09.090743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82971270-d193-4147-b2b4-56a6b31d9a55 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:09.298905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-82971270-d193-4147-b2b4-56a6b31d9a55 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:09.307797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-82971270-d193-4147-b2b4-56a6b31d9a55 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.232004 Apr 19 03:51:09.308416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 568/1184] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:09 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:10.325508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2ff6c8b0-45e8-46c9-9230-b486216a038e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:10.326173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2ff6c8b0-45e8-46c9-9230-b486216a038e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:10.334483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ff6c8b0-45e8-46c9-9230-b486216a038e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:10.334989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ff6c8b0-45e8-46c9-9230-b486216a038e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:10.335840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ff6c8b0-45e8-46c9-9230-b486216a038e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:10.336327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2ff6c8b0-45e8-46c9-9230-b486216a038e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:10.544606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2ff6c8b0-45e8-46c9-9230-b486216a038e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:10.553478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2ff6c8b0-45e8-46c9-9230-b486216a038e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.232007 Apr 19 03:51:10.554099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 617/1185] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:10 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:11.571878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6d4509f1-d8ba-4ba4-8dad-0f839348ac78 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:11.572488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6d4509f1-d8ba-4ba4-8dad-0f839348ac78 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:11.580416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d4509f1-d8ba-4ba4-8dad-0f839348ac78 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:11.580924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d4509f1-d8ba-4ba4-8dad-0f839348ac78 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:11.581755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d4509f1-d8ba-4ba4-8dad-0f839348ac78 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:11.582244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d4509f1-d8ba-4ba4-8dad-0f839348ac78 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:11.797001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6d4509f1-d8ba-4ba4-8dad-0f839348ac78 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:11.806599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6d4509f1-d8ba-4ba4-8dad-0f839348ac78 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.238858 Apr 19 03:51:11.807262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 569/1186] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:11 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:12.824769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6c239fc6-f54b-40c6-a767-7768a0ccfcb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:12.825447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6c239fc6-f54b-40c6-a767-7768a0ccfcb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:12.833417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c239fc6-f54b-40c6-a767-7768a0ccfcb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:12.833925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c239fc6-f54b-40c6-a767-7768a0ccfcb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:12.834761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c239fc6-f54b-40c6-a767-7768a0ccfcb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:12.835283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c239fc6-f54b-40c6-a767-7768a0ccfcb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:13.050839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6c239fc6-f54b-40c6-a767-7768a0ccfcb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:13.060336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6c239fc6-f54b-40c6-a767-7768a0ccfcb0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.239873 Apr 19 03:51:13.060956 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 618/1187] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:12 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:13.418412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1efc1403-2243-4c20-a65b-1e8ff60633fa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:13.418963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1efc1403-2243-4c20-a65b-1e8ff60633fa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:13.426743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1efc1403-2243-4c20-a65b-1e8ff60633fa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:13.427311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1efc1403-2243-4c20-a65b-1e8ff60633fa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:13.428143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1efc1403-2243-4c20-a65b-1e8ff60633fa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:13.428636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1efc1403-2243-4c20-a65b-1e8ff60633fa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:13.496181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1efc1403-2243-4c20-a65b-1e8ff60633fa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:51:13.701378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1efc1403-2243-4c20-a65b-1e8ff60633fa tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 204 len: 0 microversion: 2.20 time: 0.286694 Apr 19 03:51:13.702021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 570/1188] 10.222.0.25 () {60 vars in 1270 bytes} [Mon Apr 19 03:51:13 2021] DELETE /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 03:51:13.711246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9239eea8-e760-4069-8375-ab21e7379c50 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:13.711866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9239eea8-e760-4069-8375-ab21e7379c50 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:13.719765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9239eea8-e760-4069-8375-ab21e7379c50 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:13.720274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9239eea8-e760-4069-8375-ab21e7379c50 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:13.721840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9239eea8-e760-4069-8375-ab21e7379c50 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:13.722345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9239eea8-e760-4069-8375-ab21e7379c50 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:13.932339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9239eea8-e760-4069-8375-ab21e7379c50 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:13.943066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9239eea8-e760-4069-8375-ab21e7379c50 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:13.944784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9239eea8-e760-4069-8375-ab21e7379c50 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:13.946001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9239eea8-e760-4069-8375-ab21e7379c50 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1724 microversion: 2.20 time: 0.238953 Apr 19 03:51:13.946625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 619/1189] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:51:13 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:51:14.078896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b52cdf9e-df3e-4ce8-8442-3f864db14962 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:14.079750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b52cdf9e-df3e-4ce8-8442-3f864db14962 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:14.088165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b52cdf9e-df3e-4ce8-8442-3f864db14962 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:14.088671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b52cdf9e-df3e-4ce8-8442-3f864db14962 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:14.089535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b52cdf9e-df3e-4ce8-8442-3f864db14962 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:14.090017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b52cdf9e-df3e-4ce8-8442-3f864db14962 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:14.305564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b52cdf9e-df3e-4ce8-8442-3f864db14962 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:14.315339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b52cdf9e-df3e-4ce8-8442-3f864db14962 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.240405 Apr 19 03:51:14.316161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 571/1190] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:14 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:14.966651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ce99196d-a611-484b-9398-48547c407cbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:14.967348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ce99196d-a611-484b-9398-48547c407cbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:14.975861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce99196d-a611-484b-9398-48547c407cbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:14.976361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce99196d-a611-484b-9398-48547c407cbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:14.977181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce99196d-a611-484b-9398-48547c407cbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:14.977666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce99196d-a611-484b-9398-48547c407cbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:15.144156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ce99196d-a611-484b-9398-48547c407cbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:15.154049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ce99196d-a611-484b-9398-48547c407cbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:15.155820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ce99196d-a611-484b-9398-48547c407cbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:15.156963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ce99196d-a611-484b-9398-48547c407cbe tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1656 microversion: 2.20 time: 0.194588 Apr 19 03:51:15.157841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 620/1191] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:51:14 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1656 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:51:15.334630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bd78d4af-7e1f-444a-95a9-a213f387bc25 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:15.335332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bd78d4af-7e1f-444a-95a9-a213f387bc25 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:15.343600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd78d4af-7e1f-444a-95a9-a213f387bc25 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:15.344110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd78d4af-7e1f-444a-95a9-a213f387bc25 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:15.344942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd78d4af-7e1f-444a-95a9-a213f387bc25 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:15.345428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd78d4af-7e1f-444a-95a9-a213f387bc25 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:15.583835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bd78d4af-7e1f-444a-95a9-a213f387bc25 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:15.599461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bd78d4af-7e1f-444a-95a9-a213f387bc25 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.269729 Apr 19 03:51:15.600502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 572/1192] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:15 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:16.013038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-78e5f5e3-9ca6-4606-a1f4-1986fc611b67 req-52f5a5cf-4819-4dc2-981c-1253acceeb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b970f17-73a6-4e13-845d-a2ead7223a67", "name": "network-vif-deleted", "tag": "73d56411-e2cc-4061-8eeb-efbbcd8b0986"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:51:16.015181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:51:16.015181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:51:16.025285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-78e5f5e3-9ca6-4606-a1f4-1986fc611b67 req-52f5a5cf-4819-4dc2-981c-1253acceeb35 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:16.026132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-78e5f5e3-9ca6-4606-a1f4-1986fc611b67 req-52f5a5cf-4819-4dc2-981c-1253acceeb35 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:16.052733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-78e5f5e3-9ca6-4606-a1f4-1986fc611b67 req-52f5a5cf-4819-4dc2-981c-1253acceeb35 service nova] Creating event network-vif-deleted:73d56411-e2cc-4061-8eeb-efbbcd8b0986 for instance 7b970f17-73a6-4e13-845d-a2ead7223a67 on hv-cinder-78605 Apr 19 03:51:16.058517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-78e5f5e3-9ca6-4606-a1f4-1986fc611b67 req-52f5a5cf-4819-4dc2-981c-1253acceeb35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155571 Apr 19 03:51:16.059054 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 621/1193] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:51:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:51:16.177568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:16.178231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:16.186449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:16.186958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:16.187829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:16.188317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:16.267879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:16.267879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:16.268707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lazy-loading 'fault' on Instance uuid 7b970f17-73a6-4e13-845d-a2ead7223a67 {{(pid=100590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:51:16.333335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:16.342705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:16.344410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4c276e843fab41419f611a5dd2adc9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1596875092a4918b57b2ca36f54fbd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:16.345614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-20004d34-9283-41ba-b737-b4c4962f592e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 200 len: 1371 microversion: 2.20 time: 0.172884 Apr 19 03:51:16.346888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 573/1194] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:51:16 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 03:51:16.654585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1942ccb1-b0b4-47b7-b93e-b2120a13876a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:16.655570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1942ccb1-b0b4-47b7-b93e-b2120a13876a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:16.665077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1942ccb1-b0b4-47b7-b93e-b2120a13876a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:16.665755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1942ccb1-b0b4-47b7-b93e-b2120a13876a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:16.666733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1942ccb1-b0b4-47b7-b93e-b2120a13876a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:16.667255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1942ccb1-b0b4-47b7-b93e-b2120a13876a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:16.895448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1942ccb1-b0b4-47b7-b93e-b2120a13876a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:16.904424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1942ccb1-b0b4-47b7-b93e-b2120a13876a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1561 microversion: 2.1 time: 0.254732 Apr 19 03:51:16.905272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 622/1195] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:16 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1561 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:17.366581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-73b11455-916e-41c0-9e90-87783ff19243 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:17.367305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-73b11455-916e-41c0-9e90-87783ff19243 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:17.376431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-73b11455-916e-41c0-9e90-87783ff19243 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:17.378406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-73b11455-916e-41c0-9e90-87783ff19243 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:17.379524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-73b11455-916e-41c0-9e90-87783ff19243 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:17.380405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-73b11455-916e-41c0-9e90-87783ff19243 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:17.435711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-73b11455-916e-41c0-9e90-87783ff19243 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] HTTP exception thrown: Instance 7b970f17-73a6-4e13-845d-a2ead7223a67 could not be found. Apr 19 03:51:17.436529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-73b11455-916e-41c0-9e90-87783ff19243 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Returning 404 to user: Instance 7b970f17-73a6-4e13-845d-a2ead7223a67 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:51:17.437521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-73b11455-916e-41c0-9e90-87783ff19243 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 404 len: 111 microversion: 2.20 time: 0.075905 Apr 19 03:51:17.438164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 574/1196] 10.222.0.25 () {60 vars in 1267 bytes} [Mon Apr 19 03:51:17 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 03:51:17.447728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2488691c-3a82-4302-9c68-a4d9c3953e02 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '.version_select at 0x7f9dac19d1e0>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:17.503243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2488691c-3a82-4302-9c68-a4d9c3953e02 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-233344134" status: 204 len: 0 microversion: 2.20 time: 0.059487 Apr 19 03:51:17.503868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 623/1197] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Apr 19 03:51:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-233344134 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 03:51:18.866872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dc3a50b7-2025-4429-b2e1-db0446fc5667 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:18.867474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dc3a50b7-2025-4429-b2e1-db0446fc5667 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:18.875893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc3a50b7-2025-4429-b2e1-db0446fc5667 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:18.876408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc3a50b7-2025-4429-b2e1-db0446fc5667 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:18.877840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc3a50b7-2025-4429-b2e1-db0446fc5667 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:18.878331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dc3a50b7-2025-4429-b2e1-db0446fc5667 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:18.948550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dc3a50b7-2025-4429-b2e1-db0446fc5667 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:51:18.960838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-1622f83d-81a8-4d61-b1d9-bf560bd649d1 req-143b4299-d8e0-4378-a286-9ee0a9816290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc5cf11-07e5-4749-b662-5d41fef38609", "tag": "fbdc9349-8214-499d-88ec-f32902245c65"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:51:18.962857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:51:18.962857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:51:18.975252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-1622f83d-81a8-4d61-b1d9-bf560bd649d1 req-143b4299-d8e0-4378-a286-9ee0a9816290 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:18.976033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-1622f83d-81a8-4d61-b1d9-bf560bd649d1 req-143b4299-d8e0-4378-a286-9ee0a9816290 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:18.994723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-1622f83d-81a8-4d61-b1d9-bf560bd649d1 req-143b4299-d8e0-4378-a286-9ee0a9816290 service nova] Creating event network-changed:fbdc9349-8214-499d-88ec-f32902245c65 for instance 3cc5cf11-07e5-4749-b662-5d41fef38609 on hv-cinder-78605 Apr 19 03:51:19.000481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-1622f83d-81a8-4d61-b1d9-bf560bd649d1 req-143b4299-d8e0-4378-a286-9ee0a9816290 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141694 Apr 19 03:51:19.001712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 624/1198] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:51:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:51:19.221648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dc3a50b7-2025-4429-b2e1-db0446fc5667 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 204 len: 0 microversion: 2.1 time: 0.365054 Apr 19 03:51:19.223319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 575/1199] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:51:18 2021] DELETE /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:51:19.232415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-33c60fd9-ff18-474b-bcaa-306f987a587b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:19.233175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-33c60fd9-ff18-474b-bcaa-306f987a587b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:19.242761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33c60fd9-ff18-474b-bcaa-306f987a587b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:19.243393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33c60fd9-ff18-474b-bcaa-306f987a587b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:19.244495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33c60fd9-ff18-474b-bcaa-306f987a587b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:19.245078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-33c60fd9-ff18-474b-bcaa-306f987a587b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:19.802330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-33c60fd9-ff18-474b-bcaa-306f987a587b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:19.812359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-33c60fd9-ff18-474b-bcaa-306f987a587b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1567 microversion: 2.1 time: 0.584381 Apr 19 03:51:19.813369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 625/1200] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:19 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1567 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:20.803659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-6b034ee0-23ea-4aa6-89c4-a6aeaa380ac5 req-5d0d9819-bd14-4378-ae90-e65a218faa1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc5cf11-07e5-4749-b662-5d41fef38609", "name": "network-vif-deleted", "tag": "fbdc9349-8214-499d-88ec-f32902245c65"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:51:20.805864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:51:20.805864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:51:20.818679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-6b034ee0-23ea-4aa6-89c4-a6aeaa380ac5 req-5d0d9819-bd14-4378-ae90-e65a218faa1b service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:20.819192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-6b034ee0-23ea-4aa6-89c4-a6aeaa380ac5 req-5d0d9819-bd14-4378-ae90-e65a218faa1b service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:20.832100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6d34d772-d3f7-4191-8c24-0dd43359d857 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:20.832792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6d34d772-d3f7-4191-8c24-0dd43359d857 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:20.839791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-6b034ee0-23ea-4aa6-89c4-a6aeaa380ac5 req-5d0d9819-bd14-4378-ae90-e65a218faa1b service nova] Creating event network-vif-deleted:fbdc9349-8214-499d-88ec-f32902245c65 for instance 3cc5cf11-07e5-4749-b662-5d41fef38609 on hv-cinder-78605 Apr 19 03:51:20.841061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d34d772-d3f7-4191-8c24-0dd43359d857 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:20.841576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d34d772-d3f7-4191-8c24-0dd43359d857 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:20.842436 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d34d772-d3f7-4191-8c24-0dd43359d857 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:20.842931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d34d772-d3f7-4191-8c24-0dd43359d857 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:20.845868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-6b034ee0-23ea-4aa6-89c4-a6aeaa380ac5 req-5d0d9819-bd14-4378-ae90-e65a218faa1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046835 Apr 19 03:51:20.846724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 576/1201] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:51:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:51:21.008092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6d34d772-d3f7-4191-8c24-0dd43359d857 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:21.016887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6d34d772-d3f7-4191-8c24-0dd43359d857 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.189676 Apr 19 03:51:21.017533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 626/1202] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:20 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:22.035627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3ba2021c-eb85-4975-91f5-3bfd3c3cdc52 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:22.036445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3ba2021c-eb85-4975-91f5-3bfd3c3cdc52 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:22.044494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ba2021c-eb85-4975-91f5-3bfd3c3cdc52 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:22.045002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ba2021c-eb85-4975-91f5-3bfd3c3cdc52 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:22.045826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ba2021c-eb85-4975-91f5-3bfd3c3cdc52 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:22.046313 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ba2021c-eb85-4975-91f5-3bfd3c3cdc52 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:22.185472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3ba2021c-eb85-4975-91f5-3bfd3c3cdc52 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:22.194913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3ba2021c-eb85-4975-91f5-3bfd3c3cdc52 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.163908 Apr 19 03:51:22.195661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 577/1203] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:22 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:23.213098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3ae4e7c1-8d57-4450-953c-aaa45dbcec6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:23.213765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3ae4e7c1-8d57-4450-953c-aaa45dbcec6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:23.222304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ae4e7c1-8d57-4450-953c-aaa45dbcec6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:23.222812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ae4e7c1-8d57-4450-953c-aaa45dbcec6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:23.223671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ae4e7c1-8d57-4450-953c-aaa45dbcec6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:23.224163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ae4e7c1-8d57-4450-953c-aaa45dbcec6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:23.349845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3ae4e7c1-8d57-4450-953c-aaa45dbcec6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:23.358803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3ae4e7c1-8d57-4450-953c-aaa45dbcec6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149936 Apr 19 03:51:23.359449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 627/1204] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:23 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:51:24.377132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f5aa25fe-d796-4fce-afc7-9a2fbfb86f21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:24.377797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f5aa25fe-d796-4fce-afc7-9a2fbfb86f21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:24.385628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5aa25fe-d796-4fce-afc7-9a2fbfb86f21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:24.386134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5aa25fe-d796-4fce-afc7-9a2fbfb86f21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:24.386973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5aa25fe-d796-4fce-afc7-9a2fbfb86f21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:24.387516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5aa25fe-d796-4fce-afc7-9a2fbfb86f21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:24.509337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f5aa25fe-d796-4fce-afc7-9a2fbfb86f21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:24.518122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f5aa25fe-d796-4fce-afc7-9a2fbfb86f21 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145099 Apr 19 03:51:24.518739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 578/1205] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:24 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:25.536164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9a723dc6-94cf-4daa-977c-a9e2ce5ace88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:25.536884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9a723dc6-94cf-4daa-977c-a9e2ce5ace88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:25.544741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a723dc6-94cf-4daa-977c-a9e2ce5ace88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:25.545241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a723dc6-94cf-4daa-977c-a9e2ce5ace88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:25.546054 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a723dc6-94cf-4daa-977c-a9e2ce5ace88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:25.546761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a723dc6-94cf-4daa-977c-a9e2ce5ace88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:25.671287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9a723dc6-94cf-4daa-977c-a9e2ce5ace88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:25.680469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9a723dc6-94cf-4daa-977c-a9e2ce5ace88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148447 Apr 19 03:51:25.681082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 628/1206] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:25 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:26.699389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-54e3d80c-c20c-4981-bef7-d6a76d50cfa6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:26.700063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-54e3d80c-c20c-4981-bef7-d6a76d50cfa6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:26.708618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54e3d80c-c20c-4981-bef7-d6a76d50cfa6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:26.709124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54e3d80c-c20c-4981-bef7-d6a76d50cfa6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:26.709954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54e3d80c-c20c-4981-bef7-d6a76d50cfa6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:26.710441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54e3d80c-c20c-4981-bef7-d6a76d50cfa6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:26.833377 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-54e3d80c-c20c-4981-bef7-d6a76d50cfa6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:26.842100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-54e3d80c-c20c-4981-bef7-d6a76d50cfa6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146847 Apr 19 03:51:26.842718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 579/1207] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:26 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:27.860345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-42c4d0d9-c459-4d8e-8015-087d79688d8b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:27.860983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-42c4d0d9-c459-4d8e-8015-087d79688d8b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:27.869341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42c4d0d9-c459-4d8e-8015-087d79688d8b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:27.869847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42c4d0d9-c459-4d8e-8015-087d79688d8b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:27.870659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42c4d0d9-c459-4d8e-8015-087d79688d8b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:27.871174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-42c4d0d9-c459-4d8e-8015-087d79688d8b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:28.026049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-42c4d0d9-c459-4d8e-8015-087d79688d8b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:28.034801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-42c4d0d9-c459-4d8e-8015-087d79688d8b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.178690 Apr 19 03:51:28.035442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 629/1208] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:27 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:29.053511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3fc03c65-d535-411d-97a8-3a797dfb9251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:29.054176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3fc03c65-d535-411d-97a8-3a797dfb9251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:29.062174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fc03c65-d535-411d-97a8-3a797dfb9251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:29.062692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fc03c65-d535-411d-97a8-3a797dfb9251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:29.063538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fc03c65-d535-411d-97a8-3a797dfb9251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:29.064029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3fc03c65-d535-411d-97a8-3a797dfb9251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:29.188607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3fc03c65-d535-411d-97a8-3a797dfb9251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:29.197512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3fc03c65-d535-411d-97a8-3a797dfb9251 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148838 Apr 19 03:51:29.198122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 580/1209] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:29 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:30.215844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a6d96d28-eb0b-402d-b980-279ea91d9db2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:30.216553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a6d96d28-eb0b-402d-b980-279ea91d9db2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:30.224349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a6d96d28-eb0b-402d-b980-279ea91d9db2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:30.224848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a6d96d28-eb0b-402d-b980-279ea91d9db2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:30.225671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a6d96d28-eb0b-402d-b980-279ea91d9db2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:30.226166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a6d96d28-eb0b-402d-b980-279ea91d9db2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:30.351335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a6d96d28-eb0b-402d-b980-279ea91d9db2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:30.360216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a6d96d28-eb0b-402d-b980-279ea91d9db2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148485 Apr 19 03:51:30.360892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 630/1210] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:30 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:31.380221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e7b293a1-962d-44f2-8b53-6c7173526678 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:31.380888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e7b293a1-962d-44f2-8b53-6c7173526678 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:31.388818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7b293a1-962d-44f2-8b53-6c7173526678 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:31.389323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7b293a1-962d-44f2-8b53-6c7173526678 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:31.390148 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7b293a1-962d-44f2-8b53-6c7173526678 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:31.390631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7b293a1-962d-44f2-8b53-6c7173526678 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:31.514296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e7b293a1-962d-44f2-8b53-6c7173526678 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:31.523393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e7b293a1-962d-44f2-8b53-6c7173526678 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147902 Apr 19 03:51:31.524008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 581/1211] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:31 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:32.540811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2e32c659-cf4a-445d-bce7-102b33c2a525 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:32.541482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2e32c659-cf4a-445d-bce7-102b33c2a525 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:32.549710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2e32c659-cf4a-445d-bce7-102b33c2a525 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:32.550222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2e32c659-cf4a-445d-bce7-102b33c2a525 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:32.551104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2e32c659-cf4a-445d-bce7-102b33c2a525 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:32.551651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2e32c659-cf4a-445d-bce7-102b33c2a525 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:32.673873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2e32c659-cf4a-445d-bce7-102b33c2a525 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:32.682725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2e32c659-cf4a-445d-bce7-102b33c2a525 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146083 Apr 19 03:51:32.683360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 631/1212] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:32 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:33.701403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-53dadbbe-127c-4247-b1ef-e961bad76c4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:33.702069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-53dadbbe-127c-4247-b1ef-e961bad76c4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:33.710319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53dadbbe-127c-4247-b1ef-e961bad76c4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:33.710819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53dadbbe-127c-4247-b1ef-e961bad76c4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:33.711668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53dadbbe-127c-4247-b1ef-e961bad76c4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:33.712153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-53dadbbe-127c-4247-b1ef-e961bad76c4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:33.838631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-53dadbbe-127c-4247-b1ef-e961bad76c4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:33.848144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-53dadbbe-127c-4247-b1ef-e961bad76c4d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.150704 Apr 19 03:51:33.848641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 582/1213] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:33 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:34.865900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3d661818-6fc4-4916-986d-f604ba9b85b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:34.866870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3d661818-6fc4-4916-986d-f604ba9b85b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:34.874680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d661818-6fc4-4916-986d-f604ba9b85b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:34.875230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d661818-6fc4-4916-986d-f604ba9b85b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:34.876074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d661818-6fc4-4916-986d-f604ba9b85b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:34.876572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d661818-6fc4-4916-986d-f604ba9b85b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:35.004900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3d661818-6fc4-4916-986d-f604ba9b85b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:35.013807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3d661818-6fc4-4916-986d-f604ba9b85b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.152707 Apr 19 03:51:35.014422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 632/1214] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:34 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:36.031783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c56b9bf5-f543-4dd6-ab48-41093d3a4e45 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:36.032461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c56b9bf5-f543-4dd6-ab48-41093d3a4e45 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:36.040294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c56b9bf5-f543-4dd6-ab48-41093d3a4e45 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:36.040801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c56b9bf5-f543-4dd6-ab48-41093d3a4e45 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:36.041633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c56b9bf5-f543-4dd6-ab48-41093d3a4e45 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:36.042125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c56b9bf5-f543-4dd6-ab48-41093d3a4e45 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:36.166116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c56b9bf5-f543-4dd6-ab48-41093d3a4e45 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:36.175470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c56b9bf5-f543-4dd6-ab48-41093d3a4e45 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147753 Apr 19 03:51:36.176085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 583/1215] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:36 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:37.194081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-15ec46ec-938e-4e2e-9ab1-1c2de523949b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:37.194754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-15ec46ec-938e-4e2e-9ab1-1c2de523949b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:37.202580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-15ec46ec-938e-4e2e-9ab1-1c2de523949b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:37.203091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-15ec46ec-938e-4e2e-9ab1-1c2de523949b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:37.203944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-15ec46ec-938e-4e2e-9ab1-1c2de523949b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:37.205044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-15ec46ec-938e-4e2e-9ab1-1c2de523949b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:37.325378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-15ec46ec-938e-4e2e-9ab1-1c2de523949b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:37.335269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-15ec46ec-938e-4e2e-9ab1-1c2de523949b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145377 Apr 19 03:51:37.335878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 633/1216] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:37 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:38.353359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e7187a58-2388-43e8-8c2b-93196658f810 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:38.354062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e7187a58-2388-43e8-8c2b-93196658f810 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:38.361832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7187a58-2388-43e8-8c2b-93196658f810 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:38.362335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7187a58-2388-43e8-8c2b-93196658f810 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:38.363174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7187a58-2388-43e8-8c2b-93196658f810 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:38.363692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7187a58-2388-43e8-8c2b-93196658f810 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:38.485944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e7187a58-2388-43e8-8c2b-93196658f810 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:38.495116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e7187a58-2388-43e8-8c2b-93196658f810 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145886 Apr 19 03:51:38.495784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 584/1217] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:38 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:39.513864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-488135fd-bc3c-43bd-a25d-a68adf45da6f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:39.514530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-488135fd-bc3c-43bd-a25d-a68adf45da6f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:39.522969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-488135fd-bc3c-43bd-a25d-a68adf45da6f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:39.523508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-488135fd-bc3c-43bd-a25d-a68adf45da6f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:39.524326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-488135fd-bc3c-43bd-a25d-a68adf45da6f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:39.524813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-488135fd-bc3c-43bd-a25d-a68adf45da6f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:39.646206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-488135fd-bc3c-43bd-a25d-a68adf45da6f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:39.655096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-488135fd-bc3c-43bd-a25d-a68adf45da6f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145373 Apr 19 03:51:39.655732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 634/1218] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:39 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:40.673308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-087e37d6-bd3c-42d1-a3c0-599c5b81efb3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:40.673969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-087e37d6-bd3c-42d1-a3c0-599c5b81efb3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:40.681805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-087e37d6-bd3c-42d1-a3c0-599c5b81efb3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:40.682308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-087e37d6-bd3c-42d1-a3c0-599c5b81efb3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:40.683132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-087e37d6-bd3c-42d1-a3c0-599c5b81efb3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:40.683640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-087e37d6-bd3c-42d1-a3c0-599c5b81efb3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:40.825963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-087e37d6-bd3c-42d1-a3c0-599c5b81efb3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:40.835291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-087e37d6-bd3c-42d1-a3c0-599c5b81efb3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.166228 Apr 19 03:51:40.835905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 585/1219] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:40 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:41.853746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cb3697a1-657c-4b87-9e7b-fa82dd9905c7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:41.854357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cb3697a1-657c-4b87-9e7b-fa82dd9905c7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:41.862810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb3697a1-657c-4b87-9e7b-fa82dd9905c7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:41.863351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb3697a1-657c-4b87-9e7b-fa82dd9905c7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:41.864178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb3697a1-657c-4b87-9e7b-fa82dd9905c7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:41.864668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb3697a1-657c-4b87-9e7b-fa82dd9905c7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:41.991577 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cb3697a1-657c-4b87-9e7b-fa82dd9905c7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:42.000468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cb3697a1-657c-4b87-9e7b-fa82dd9905c7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.150909 Apr 19 03:51:42.001109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 635/1220] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:41 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:43.018422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9a45972e-2ed0-4cde-8b86-6bb0d6b649d7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:43.019099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9a45972e-2ed0-4cde-8b86-6bb0d6b649d7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:43.027026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a45972e-2ed0-4cde-8b86-6bb0d6b649d7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:43.027574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a45972e-2ed0-4cde-8b86-6bb0d6b649d7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:43.028409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a45972e-2ed0-4cde-8b86-6bb0d6b649d7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:43.028909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a45972e-2ed0-4cde-8b86-6bb0d6b649d7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:43.153727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9a45972e-2ed0-4cde-8b86-6bb0d6b649d7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:43.163175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9a45972e-2ed0-4cde-8b86-6bb0d6b649d7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148883 Apr 19 03:51:43.163782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 586/1221] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:43 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:44.181543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6cb4c877-40c2-4836-a9a6-3bab659ae80d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:44.182217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6cb4c877-40c2-4836-a9a6-3bab659ae80d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:44.190662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cb4c877-40c2-4836-a9a6-3bab659ae80d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:44.191194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cb4c877-40c2-4836-a9a6-3bab659ae80d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:44.192019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cb4c877-40c2-4836-a9a6-3bab659ae80d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:44.192511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6cb4c877-40c2-4836-a9a6-3bab659ae80d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:44.317826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6cb4c877-40c2-4836-a9a6-3bab659ae80d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:44.326587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6cb4c877-40c2-4836-a9a6-3bab659ae80d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149246 Apr 19 03:51:44.327234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 636/1222] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:44 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:45.345070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5cb3f9be-c425-4f0c-9616-589494a08e80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:45.345747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5cb3f9be-c425-4f0c-9616-589494a08e80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:45.353616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cb3f9be-c425-4f0c-9616-589494a08e80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:45.354122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cb3f9be-c425-4f0c-9616-589494a08e80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:45.354946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cb3f9be-c425-4f0c-9616-589494a08e80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:45.355488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cb3f9be-c425-4f0c-9616-589494a08e80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:45.476903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5cb3f9be-c425-4f0c-9616-589494a08e80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:45.485790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5cb3f9be-c425-4f0c-9616-589494a08e80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.144872 Apr 19 03:51:45.486404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 587/1223] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:45 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:46.504691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7ad15a67-6cc7-4c14-802a-4a71963c2c64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:46.505355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7ad15a67-6cc7-4c14-802a-4a71963c2c64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:46.513220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ad15a67-6cc7-4c14-802a-4a71963c2c64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:46.513731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ad15a67-6cc7-4c14-802a-4a71963c2c64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:46.514560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ad15a67-6cc7-4c14-802a-4a71963c2c64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:46.515050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7ad15a67-6cc7-4c14-802a-4a71963c2c64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:46.637386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7ad15a67-6cc7-4c14-802a-4a71963c2c64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:46.646324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7ad15a67-6cc7-4c14-802a-4a71963c2c64 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146417 Apr 19 03:51:46.646933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 637/1224] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:46 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:47.663971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9a4eb2f2-df95-45bc-8606-1cdccfbba720 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:47.664645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9a4eb2f2-df95-45bc-8606-1cdccfbba720 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:47.672503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a4eb2f2-df95-45bc-8606-1cdccfbba720 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:47.673016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a4eb2f2-df95-45bc-8606-1cdccfbba720 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:47.673853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a4eb2f2-df95-45bc-8606-1cdccfbba720 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:47.674348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a4eb2f2-df95-45bc-8606-1cdccfbba720 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:47.836350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9a4eb2f2-df95-45bc-8606-1cdccfbba720 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:47.845122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9a4eb2f2-df95-45bc-8606-1cdccfbba720 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.185240 Apr 19 03:51:47.845735 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 588/1225] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:47 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:48.862181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5094be36-92e8-413f-867b-10f444810d03 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:48.862883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5094be36-92e8-413f-867b-10f444810d03 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:48.870937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5094be36-92e8-413f-867b-10f444810d03 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:48.873615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5094be36-92e8-413f-867b-10f444810d03 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:48.873615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5094be36-92e8-413f-867b-10f444810d03 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:48.873615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5094be36-92e8-413f-867b-10f444810d03 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:49.001757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5094be36-92e8-413f-867b-10f444810d03 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:49.010435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5094be36-92e8-413f-867b-10f444810d03 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.152364 Apr 19 03:51:49.011046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 638/1226] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:48 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:50.029153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2419c8f4-d681-4aba-beef-dd706aa30be9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:50.029828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2419c8f4-d681-4aba-beef-dd706aa30be9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:50.038274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2419c8f4-d681-4aba-beef-dd706aa30be9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:50.038783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2419c8f4-d681-4aba-beef-dd706aa30be9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:50.039644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2419c8f4-d681-4aba-beef-dd706aa30be9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:50.040141 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2419c8f4-d681-4aba-beef-dd706aa30be9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:50.165568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2419c8f4-d681-4aba-beef-dd706aa30be9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:50.174554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2419c8f4-d681-4aba-beef-dd706aa30be9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149542 Apr 19 03:51:50.175175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 589/1227] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:50 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:51.192761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a1e4cd68-b387-4eaa-8e93-1589e0474d41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:51.193394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a1e4cd68-b387-4eaa-8e93-1589e0474d41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:51.201273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1e4cd68-b387-4eaa-8e93-1589e0474d41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:51.201782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1e4cd68-b387-4eaa-8e93-1589e0474d41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:51.202610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1e4cd68-b387-4eaa-8e93-1589e0474d41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:51.203102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1e4cd68-b387-4eaa-8e93-1589e0474d41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:51.325564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a1e4cd68-b387-4eaa-8e93-1589e0474d41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:51.334777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a1e4cd68-b387-4eaa-8e93-1589e0474d41 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146782 Apr 19 03:51:51.335450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 639/1228] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:51 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:52.353435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2515a56d-42b1-4c6b-a38a-e48d0bd96e88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:52.354117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2515a56d-42b1-4c6b-a38a-e48d0bd96e88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:52.362020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2515a56d-42b1-4c6b-a38a-e48d0bd96e88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:52.362534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2515a56d-42b1-4c6b-a38a-e48d0bd96e88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:52.363404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2515a56d-42b1-4c6b-a38a-e48d0bd96e88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:52.363900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2515a56d-42b1-4c6b-a38a-e48d0bd96e88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:52.488117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2515a56d-42b1-4c6b-a38a-e48d0bd96e88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:52.497567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2515a56d-42b1-4c6b-a38a-e48d0bd96e88 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148347 Apr 19 03:51:52.498188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 590/1229] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:52 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:53.517108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-10d7fee6-b3f3-4147-a47e-8a22e7e8b45b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:53.517779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-10d7fee6-b3f3-4147-a47e-8a22e7e8b45b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:53.525690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10d7fee6-b3f3-4147-a47e-8a22e7e8b45b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:53.526147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10d7fee6-b3f3-4147-a47e-8a22e7e8b45b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:53.526970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10d7fee6-b3f3-4147-a47e-8a22e7e8b45b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:53.527485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10d7fee6-b3f3-4147-a47e-8a22e7e8b45b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:53.648934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-10d7fee6-b3f3-4147-a47e-8a22e7e8b45b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:53.657891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-10d7fee6-b3f3-4147-a47e-8a22e7e8b45b tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145634 Apr 19 03:51:53.658516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 640/1230] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:53 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:54.676074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7a6815d0-3c85-4055-af39-784dbd41a264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:54.676746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7a6815d0-3c85-4055-af39-784dbd41a264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:54.684581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7a6815d0-3c85-4055-af39-784dbd41a264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:54.685095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7a6815d0-3c85-4055-af39-784dbd41a264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:54.685921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7a6815d0-3c85-4055-af39-784dbd41a264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:54.686412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7a6815d0-3c85-4055-af39-784dbd41a264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:54.809842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7a6815d0-3c85-4055-af39-784dbd41a264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:54.818551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7a6815d0-3c85-4055-af39-784dbd41a264 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146647 Apr 19 03:51:54.819187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 591/1231] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:54 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:55.836645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bcbd5585-b971-4d36-861e-e8d5ef0114e6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:55.837322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bcbd5585-b971-4d36-861e-e8d5ef0114e6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:55.845745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcbd5585-b971-4d36-861e-e8d5ef0114e6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:55.846258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcbd5585-b971-4d36-861e-e8d5ef0114e6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:55.847098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcbd5585-b971-4d36-861e-e8d5ef0114e6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:55.847625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bcbd5585-b971-4d36-861e-e8d5ef0114e6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:55.975562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bcbd5585-b971-4d36-861e-e8d5ef0114e6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:55.984391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bcbd5585-b971-4d36-861e-e8d5ef0114e6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.151900 Apr 19 03:51:55.985584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 641/1232] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:55 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:57.004015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9fae4acb-63c9-4771-9b2d-7ca7e5c32d8c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:57.004824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9fae4acb-63c9-4771-9b2d-7ca7e5c32d8c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:57.008507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 19 03:51:57.013913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fae4acb-63c9-4771-9b2d-7ca7e5c32d8c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:57.014426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fae4acb-63c9-4771-9b2d-7ca7e5c32d8c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:57.015363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fae4acb-63c9-4771-9b2d-7ca7e5c32d8c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:57.015858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fae4acb-63c9-4771-9b2d-7ca7e5c32d8c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:57.140388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9fae4acb-63c9-4771-9b2d-7ca7e5c32d8c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:57.149187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9fae4acb-63c9-4771-9b2d-7ca7e5c32d8c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149981 Apr 19 03:51:57.149812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 592/1233] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:56 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:58.167261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d5be3829-89ef-480a-89be-21a7124d50ad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:58.167939 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d5be3829-89ef-480a-89be-21a7124d50ad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:58.176410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5be3829-89ef-480a-89be-21a7124d50ad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:58.176913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5be3829-89ef-480a-89be-21a7124d50ad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:58.177744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5be3829-89ef-480a-89be-21a7124d50ad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:58.178235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5be3829-89ef-480a-89be-21a7124d50ad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:58.300908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d5be3829-89ef-480a-89be-21a7124d50ad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:58.309619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d5be3829-89ef-480a-89be-21a7124d50ad tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146495 Apr 19 03:51:58.310241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 642/1234] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:58 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:51:59.328182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0ffc02af-6863-422c-84be-ca799ad27ce8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:51:59.328859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0ffc02af-6863-422c-84be-ca799ad27ce8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:51:59.347076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ffc02af-6863-422c-84be-ca799ad27ce8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:59.347636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ffc02af-6863-422c-84be-ca799ad27ce8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:59.348476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ffc02af-6863-422c-84be-ca799ad27ce8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:51:59.348966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0ffc02af-6863-422c-84be-ca799ad27ce8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:51:59.403668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40872. Apr 19 03:51:59.471971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0ffc02af-6863-422c-84be-ca799ad27ce8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:51:59.480763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0ffc02af-6863-422c-84be-ca799ad27ce8 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.156791 Apr 19 03:51:59.481384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 593/1235] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:51:59 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:00.499835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9ae50197-5f5a-4357-9dcd-14178acc1bcc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:00.501030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9ae50197-5f5a-4357-9dcd-14178acc1bcc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:00.508802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ae50197-5f5a-4357-9dcd-14178acc1bcc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:00.509303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ae50197-5f5a-4357-9dcd-14178acc1bcc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:00.510117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ae50197-5f5a-4357-9dcd-14178acc1bcc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:00.510602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ae50197-5f5a-4357-9dcd-14178acc1bcc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:00.632550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9ae50197-5f5a-4357-9dcd-14178acc1bcc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:00.641967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9ae50197-5f5a-4357-9dcd-14178acc1bcc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145755 Apr 19 03:52:00.642656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 643/1236] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:00 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:01.660667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e8541583-2cc3-4969-818a-4786965621b1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:01.661333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e8541583-2cc3-4969-818a-4786965621b1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:01.669171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8541583-2cc3-4969-818a-4786965621b1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:01.669715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8541583-2cc3-4969-818a-4786965621b1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:01.670533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8541583-2cc3-4969-818a-4786965621b1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:01.671018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8541583-2cc3-4969-818a-4786965621b1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:01.796527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e8541583-2cc3-4969-818a-4786965621b1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:01.805451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e8541583-2cc3-4969-818a-4786965621b1 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149595 Apr 19 03:52:01.806066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 594/1237] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:01 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:02.823965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d5656231-2cb7-4790-81c6-3ac80e38f5c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:02.824670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d5656231-2cb7-4790-81c6-3ac80e38f5c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:02.832543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5656231-2cb7-4790-81c6-3ac80e38f5c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:02.833047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5656231-2cb7-4790-81c6-3ac80e38f5c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:02.833863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5656231-2cb7-4790-81c6-3ac80e38f5c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:02.834345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5656231-2cb7-4790-81c6-3ac80e38f5c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:02.961768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d5656231-2cb7-4790-81c6-3ac80e38f5c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:02.971225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d5656231-2cb7-4790-81c6-3ac80e38f5c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.151408 Apr 19 03:52:02.971838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 644/1238] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:02 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:03.989716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4696e4cd-b0e9-4107-868d-80f146a628bd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:03.990382 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4696e4cd-b0e9-4107-868d-80f146a628bd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:03.998441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4696e4cd-b0e9-4107-868d-80f146a628bd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:03.998943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4696e4cd-b0e9-4107-868d-80f146a628bd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:03.999789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4696e4cd-b0e9-4107-868d-80f146a628bd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:04.000871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4696e4cd-b0e9-4107-868d-80f146a628bd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:04.126240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4696e4cd-b0e9-4107-868d-80f146a628bd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:04.135037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4696e4cd-b0e9-4107-868d-80f146a628bd tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149393 Apr 19 03:52:04.135724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 595/1239] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:03 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:05.153219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-30a2abff-78ec-4df4-845b-320a5a7a6de5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:05.153891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-30a2abff-78ec-4df4-845b-320a5a7a6de5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:05.161756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30a2abff-78ec-4df4-845b-320a5a7a6de5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:05.162257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30a2abff-78ec-4df4-845b-320a5a7a6de5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:05.163078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30a2abff-78ec-4df4-845b-320a5a7a6de5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:05.163622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-30a2abff-78ec-4df4-845b-320a5a7a6de5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:05.284576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-30a2abff-78ec-4df4-845b-320a5a7a6de5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:05.293222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-30a2abff-78ec-4df4-845b-320a5a7a6de5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.144212 Apr 19 03:52:05.293842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 645/1240] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:05 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:06.311689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2250e9a7-e3f4-4576-be37-8c7f6f8f26a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:06.312357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2250e9a7-e3f4-4576-be37-8c7f6f8f26a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:06.320626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2250e9a7-e3f4-4576-be37-8c7f6f8f26a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:06.321124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2250e9a7-e3f4-4576-be37-8c7f6f8f26a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:06.321953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2250e9a7-e3f4-4576-be37-8c7f6f8f26a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:06.322438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2250e9a7-e3f4-4576-be37-8c7f6f8f26a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:06.443842 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2250e9a7-e3f4-4576-be37-8c7f6f8f26a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:06.452545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2250e9a7-e3f4-4576-be37-8c7f6f8f26a5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145053 Apr 19 03:52:06.453168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 596/1241] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:06 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:07.470954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-609b2200-5ff6-4315-a9bb-3c88e8bffb4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:07.471706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-609b2200-5ff6-4315-a9bb-3c88e8bffb4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:07.479500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-609b2200-5ff6-4315-a9bb-3c88e8bffb4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:07.479999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-609b2200-5ff6-4315-a9bb-3c88e8bffb4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:07.480824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-609b2200-5ff6-4315-a9bb-3c88e8bffb4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:07.481303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-609b2200-5ff6-4315-a9bb-3c88e8bffb4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:07.603599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-609b2200-5ff6-4315-a9bb-3c88e8bffb4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:07.612984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-609b2200-5ff6-4315-a9bb-3c88e8bffb4e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146161 Apr 19 03:52:07.613608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 646/1242] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:07 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:08.631085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f99ee818-5b26-46f1-b94a-7bab0486cf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:08.631811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f99ee818-5b26-46f1-b94a-7bab0486cf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:08.639885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f99ee818-5b26-46f1-b94a-7bab0486cf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:08.640393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f99ee818-5b26-46f1-b94a-7bab0486cf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:08.641330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f99ee818-5b26-46f1-b94a-7bab0486cf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:08.642454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f99ee818-5b26-46f1-b94a-7bab0486cf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:08.768167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f99ee818-5b26-46f1-b94a-7bab0486cf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:08.777311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f99ee818-5b26-46f1-b94a-7bab0486cf2a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.150821 Apr 19 03:52:08.777935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 597/1243] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:08 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:09.795470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2daaa24e-dac8-40e6-9bef-813d9e6a7945 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:09.796220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2daaa24e-dac8-40e6-9bef-813d9e6a7945 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:09.804135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2daaa24e-dac8-40e6-9bef-813d9e6a7945 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:09.804639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2daaa24e-dac8-40e6-9bef-813d9e6a7945 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:09.805470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2daaa24e-dac8-40e6-9bef-813d9e6a7945 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:09.805970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2daaa24e-dac8-40e6-9bef-813d9e6a7945 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:09.934293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2daaa24e-dac8-40e6-9bef-813d9e6a7945 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:09.943115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2daaa24e-dac8-40e6-9bef-813d9e6a7945 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.151837 Apr 19 03:52:09.943753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 647/1244] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:09 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:10.961270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d422df80-53c1-4ea5-bb81-aa47a69a8197 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:10.961934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d422df80-53c1-4ea5-bb81-aa47a69a8197 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:10.969737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d422df80-53c1-4ea5-bb81-aa47a69a8197 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:10.970729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d422df80-53c1-4ea5-bb81-aa47a69a8197 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:10.971583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d422df80-53c1-4ea5-bb81-aa47a69a8197 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:10.972068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d422df80-53c1-4ea5-bb81-aa47a69a8197 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:11.096271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d422df80-53c1-4ea5-bb81-aa47a69a8197 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:11.105090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d422df80-53c1-4ea5-bb81-aa47a69a8197 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148044 Apr 19 03:52:11.105704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 598/1245] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:10 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:12.121327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 19 03:52:12.124994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e05f9f08-0d2a-4792-be03-a994ecac0003 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:12.125704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e05f9f08-0d2a-4792-be03-a994ecac0003 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:12.134140 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e05f9f08-0d2a-4792-be03-a994ecac0003 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:12.134647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e05f9f08-0d2a-4792-be03-a994ecac0003 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:12.135504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e05f9f08-0d2a-4792-be03-a994ecac0003 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:12.135995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e05f9f08-0d2a-4792-be03-a994ecac0003 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:12.258132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e05f9f08-0d2a-4792-be03-a994ecac0003 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:12.266911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e05f9f08-0d2a-4792-be03-a994ecac0003 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147178 Apr 19 03:52:12.267556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 648/1246] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:12 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:13.284528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c704f3ca-c220-4e2c-ac67-d4ff76d5fdf0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:13.285198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c704f3ca-c220-4e2c-ac67-d4ff76d5fdf0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:13.293047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c704f3ca-c220-4e2c-ac67-d4ff76d5fdf0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:13.293552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c704f3ca-c220-4e2c-ac67-d4ff76d5fdf0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:13.294376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c704f3ca-c220-4e2c-ac67-d4ff76d5fdf0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:13.294860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c704f3ca-c220-4e2c-ac67-d4ff76d5fdf0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:13.416612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c704f3ca-c220-4e2c-ac67-d4ff76d5fdf0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:13.425860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c704f3ca-c220-4e2c-ac67-d4ff76d5fdf0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145517 Apr 19 03:52:13.426470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 599/1247] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:13 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:14.444092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-edc0ea11-dd0d-4c88-8dca-5c9fff696aba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:14.444757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-edc0ea11-dd0d-4c88-8dca-5c9fff696aba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:14.464946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-edc0ea11-dd0d-4c88-8dca-5c9fff696aba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:14.465450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-edc0ea11-dd0d-4c88-8dca-5c9fff696aba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:14.466277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-edc0ea11-dd0d-4c88-8dca-5c9fff696aba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:14.466804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-edc0ea11-dd0d-4c88-8dca-5c9fff696aba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:14.503530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 40900. Apr 19 03:52:14.590267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-edc0ea11-dd0d-4c88-8dca-5c9fff696aba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:14.599705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-edc0ea11-dd0d-4c88-8dca-5c9fff696aba tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.159693 Apr 19 03:52:14.600332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 649/1248] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:14 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:15.618321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-893ce3a1-81a2-449e-8068-89e5b2a7157c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:15.618996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-893ce3a1-81a2-449e-8068-89e5b2a7157c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:15.627502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-893ce3a1-81a2-449e-8068-89e5b2a7157c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:15.628011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-893ce3a1-81a2-449e-8068-89e5b2a7157c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:15.628840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-893ce3a1-81a2-449e-8068-89e5b2a7157c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:15.629332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-893ce3a1-81a2-449e-8068-89e5b2a7157c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:15.753385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-893ce3a1-81a2-449e-8068-89e5b2a7157c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:15.762140 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-893ce3a1-81a2-449e-8068-89e5b2a7157c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148330 Apr 19 03:52:15.762757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 600/1249] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:15 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:16.780298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-adc5faee-a825-48f2-a6ff-aec10bf1dec9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:16.780967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-adc5faee-a825-48f2-a6ff-aec10bf1dec9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:16.788898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc5faee-a825-48f2-a6ff-aec10bf1dec9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:16.789409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc5faee-a825-48f2-a6ff-aec10bf1dec9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:16.790235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc5faee-a825-48f2-a6ff-aec10bf1dec9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:16.790727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-adc5faee-a825-48f2-a6ff-aec10bf1dec9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:16.919026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-adc5faee-a825-48f2-a6ff-aec10bf1dec9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:16.927907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-adc5faee-a825-48f2-a6ff-aec10bf1dec9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.151798 Apr 19 03:52:16.928530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 650/1250] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:16 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:17.945952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fca454f9-f5da-4ebc-a9e8-d56275bcf8e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:17.946622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fca454f9-f5da-4ebc-a9e8-d56275bcf8e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:17.954922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fca454f9-f5da-4ebc-a9e8-d56275bcf8e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:17.955447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fca454f9-f5da-4ebc-a9e8-d56275bcf8e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:17.956263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fca454f9-f5da-4ebc-a9e8-d56275bcf8e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:17.956747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fca454f9-f5da-4ebc-a9e8-d56275bcf8e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:18.080633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fca454f9-f5da-4ebc-a9e8-d56275bcf8e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:18.089326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fca454f9-f5da-4ebc-a9e8-d56275bcf8e9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147515 Apr 19 03:52:18.089938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 601/1251] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:17 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:19.108007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6a603b2b-6101-4126-876e-488cec52a871 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:19.108680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6a603b2b-6101-4126-876e-488cec52a871 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:19.117398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a603b2b-6101-4126-876e-488cec52a871 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:19.117902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a603b2b-6101-4126-876e-488cec52a871 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:19.118729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a603b2b-6101-4126-876e-488cec52a871 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:19.119245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a603b2b-6101-4126-876e-488cec52a871 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:19.240831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6a603b2b-6101-4126-876e-488cec52a871 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:19.249891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6a603b2b-6101-4126-876e-488cec52a871 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146086 Apr 19 03:52:19.250508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 651/1252] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:19 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:20.267411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-05caa797-5ebe-474d-9bcf-496c90a43590 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:20.268087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-05caa797-5ebe-474d-9bcf-496c90a43590 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:20.276066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05caa797-5ebe-474d-9bcf-496c90a43590 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:20.276585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05caa797-5ebe-474d-9bcf-496c90a43590 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:20.277402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05caa797-5ebe-474d-9bcf-496c90a43590 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:20.277894 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05caa797-5ebe-474d-9bcf-496c90a43590 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:20.399730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-05caa797-5ebe-474d-9bcf-496c90a43590 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:20.408602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-05caa797-5ebe-474d-9bcf-496c90a43590 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145355 Apr 19 03:52:20.409214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 602/1253] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:20 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:21.426575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c3ffb52f-52b3-4156-a9e0-f0fba4fe8fe2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:21.427270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c3ffb52f-52b3-4156-a9e0-f0fba4fe8fe2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:21.435217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3ffb52f-52b3-4156-a9e0-f0fba4fe8fe2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:21.435720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3ffb52f-52b3-4156-a9e0-f0fba4fe8fe2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:21.436542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3ffb52f-52b3-4156-a9e0-f0fba4fe8fe2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:21.437023 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3ffb52f-52b3-4156-a9e0-f0fba4fe8fe2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:21.558731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c3ffb52f-52b3-4156-a9e0-f0fba4fe8fe2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:21.568308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c3ffb52f-52b3-4156-a9e0-f0fba4fe8fe2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145862 Apr 19 03:52:21.568928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 652/1254] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:21 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:22.586487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5e618781-7e0e-4697-87d6-d4e111fbe5be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:22.587173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5e618781-7e0e-4697-87d6-d4e111fbe5be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:22.595774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e618781-7e0e-4697-87d6-d4e111fbe5be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:22.596290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e618781-7e0e-4697-87d6-d4e111fbe5be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:22.597119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e618781-7e0e-4697-87d6-d4e111fbe5be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:22.597610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e618781-7e0e-4697-87d6-d4e111fbe5be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:22.721720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5e618781-7e0e-4697-87d6-d4e111fbe5be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:22.730509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5e618781-7e0e-4697-87d6-d4e111fbe5be tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148191 Apr 19 03:52:22.731119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 603/1255] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:22 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:23.748809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-86ceb30f-b31e-4db0-bc1c-75d81b878512 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:23.749485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-86ceb30f-b31e-4db0-bc1c-75d81b878512 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:23.757317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86ceb30f-b31e-4db0-bc1c-75d81b878512 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:23.757824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86ceb30f-b31e-4db0-bc1c-75d81b878512 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:23.758651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86ceb30f-b31e-4db0-bc1c-75d81b878512 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:23.759170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86ceb30f-b31e-4db0-bc1c-75d81b878512 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:23.887186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-86ceb30f-b31e-4db0-bc1c-75d81b878512 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:23.896464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-86ceb30f-b31e-4db0-bc1c-75d81b878512 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.151839 Apr 19 03:52:23.897082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 653/1256] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:23 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:24.914595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4123b295-cc5e-47a7-b814-4ba170e08409 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:24.915274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4123b295-cc5e-47a7-b814-4ba170e08409 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:24.923595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4123b295-cc5e-47a7-b814-4ba170e08409 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:24.924095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4123b295-cc5e-47a7-b814-4ba170e08409 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:24.924914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4123b295-cc5e-47a7-b814-4ba170e08409 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:24.925401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4123b295-cc5e-47a7-b814-4ba170e08409 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:25.050343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4123b295-cc5e-47a7-b814-4ba170e08409 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:25.059123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4123b295-cc5e-47a7-b814-4ba170e08409 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148668 Apr 19 03:52:25.059800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 604/1257] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:24 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:52:26.076951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4fe6882d-3481-450b-b9f0-3ffca684ef80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:26.077617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4fe6882d-3481-450b-b9f0-3ffca684ef80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:26.085493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4fe6882d-3481-450b-b9f0-3ffca684ef80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:26.085992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4fe6882d-3481-450b-b9f0-3ffca684ef80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:26.086813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4fe6882d-3481-450b-b9f0-3ffca684ef80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:26.087332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4fe6882d-3481-450b-b9f0-3ffca684ef80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:26.208767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4fe6882d-3481-450b-b9f0-3ffca684ef80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:26.217620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4fe6882d-3481-450b-b9f0-3ffca684ef80 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.144832 Apr 19 03:52:26.218231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 654/1258] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:26 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:27.237111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-91427ae3-dac8-4d4e-8834-7ca4cb249486 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:27.237780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-91427ae3-dac8-4d4e-8834-7ca4cb249486 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:27.245949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91427ae3-dac8-4d4e-8834-7ca4cb249486 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:27.246456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91427ae3-dac8-4d4e-8834-7ca4cb249486 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:27.247304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91427ae3-dac8-4d4e-8834-7ca4cb249486 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:27.247793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-91427ae3-dac8-4d4e-8834-7ca4cb249486 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:27.370030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-91427ae3-dac8-4d4e-8834-7ca4cb249486 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:27.378774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-91427ae3-dac8-4d4e-8834-7ca4cb249486 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146306 Apr 19 03:52:27.379419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 605/1259] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:27 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:28.396811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-347df99e-1372-4f4e-b5ac-13d2d77d7a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:28.397488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-347df99e-1372-4f4e-b5ac-13d2d77d7a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:28.405277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-347df99e-1372-4f4e-b5ac-13d2d77d7a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:28.405785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-347df99e-1372-4f4e-b5ac-13d2d77d7a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:28.406615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-347df99e-1372-4f4e-b5ac-13d2d77d7a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:28.407114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-347df99e-1372-4f4e-b5ac-13d2d77d7a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:28.528610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-347df99e-1372-4f4e-b5ac-13d2d77d7a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:28.537558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-347df99e-1372-4f4e-b5ac-13d2d77d7a22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.144835 Apr 19 03:52:28.538175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 655/1260] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:28 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:29.556025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-72e29d82-dd91-4f11-91c9-3aa31157fb2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:29.556693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-72e29d82-dd91-4f11-91c9-3aa31157fb2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:29.564640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72e29d82-dd91-4f11-91c9-3aa31157fb2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:29.565137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72e29d82-dd91-4f11-91c9-3aa31157fb2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:29.565953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72e29d82-dd91-4f11-91c9-3aa31157fb2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:29.566446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72e29d82-dd91-4f11-91c9-3aa31157fb2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:29.690191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-72e29d82-dd91-4f11-91c9-3aa31157fb2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:29.698979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-72e29d82-dd91-4f11-91c9-3aa31157fb2c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147006 Apr 19 03:52:29.699624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 606/1261] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:29 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:30.717285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-706a4c10-b426-4c20-bd32-05f01539e7d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:30.717900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-706a4c10-b426-4c20-bd32-05f01539e7d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:30.725853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-706a4c10-b426-4c20-bd32-05f01539e7d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:30.726360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-706a4c10-b426-4c20-bd32-05f01539e7d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:30.727211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-706a4c10-b426-4c20-bd32-05f01539e7d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:30.727706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-706a4c10-b426-4c20-bd32-05f01539e7d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:30.894727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-706a4c10-b426-4c20-bd32-05f01539e7d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:30.903605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-706a4c10-b426-4c20-bd32-05f01539e7d9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.190593 Apr 19 03:52:30.904226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 656/1262] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:30 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:31.921663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a5ee9ac3-76c4-4b99-8a30-10fd52628568 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:31.922330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a5ee9ac3-76c4-4b99-8a30-10fd52628568 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:31.930115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5ee9ac3-76c4-4b99-8a30-10fd52628568 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:31.930613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5ee9ac3-76c4-4b99-8a30-10fd52628568 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:31.931465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5ee9ac3-76c4-4b99-8a30-10fd52628568 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:31.931953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5ee9ac3-76c4-4b99-8a30-10fd52628568 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:32.056424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a5ee9ac3-76c4-4b99-8a30-10fd52628568 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:32.065715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a5ee9ac3-76c4-4b99-8a30-10fd52628568 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148184 Apr 19 03:52:32.066326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 607/1263] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:31 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:33.084496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d8d18933-306f-4e70-97f8-df567475f114 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:33.085162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d8d18933-306f-4e70-97f8-df567475f114 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:33.093111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8d18933-306f-4e70-97f8-df567475f114 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:33.093614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8d18933-306f-4e70-97f8-df567475f114 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:33.095035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8d18933-306f-4e70-97f8-df567475f114 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:33.095549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8d18933-306f-4e70-97f8-df567475f114 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:33.220694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d8d18933-306f-4e70-97f8-df567475f114 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:33.229386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d8d18933-306f-4e70-97f8-df567475f114 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148976 Apr 19 03:52:33.230000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 657/1264] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:33 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:52:34.247869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e7571b86-3cd2-4e2b-a1e5-3d91b32f709c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:34.248547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e7571b86-3cd2-4e2b-a1e5-3d91b32f709c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:34.256880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7571b86-3cd2-4e2b-a1e5-3d91b32f709c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:34.257390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7571b86-3cd2-4e2b-a1e5-3d91b32f709c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:34.258225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7571b86-3cd2-4e2b-a1e5-3d91b32f709c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:34.258717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7571b86-3cd2-4e2b-a1e5-3d91b32f709c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:34.602553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e7571b86-3cd2-4e2b-a1e5-3d91b32f709c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:34.612236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e7571b86-3cd2-4e2b-a1e5-3d91b32f709c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.368471 Apr 19 03:52:34.612860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 608/1265] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:34 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:35.630763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8f69a956-973d-405c-9ce7-e61b69ab82ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:35.631410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8f69a956-973d-405c-9ce7-e61b69ab82ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:35.639263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f69a956-973d-405c-9ce7-e61b69ab82ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:35.639780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f69a956-973d-405c-9ce7-e61b69ab82ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:35.640619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f69a956-973d-405c-9ce7-e61b69ab82ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:35.641772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8f69a956-973d-405c-9ce7-e61b69ab82ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:35.762212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8f69a956-973d-405c-9ce7-e61b69ab82ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:35.771747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8f69a956-973d-405c-9ce7-e61b69ab82ec tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145146 Apr 19 03:52:35.772357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 658/1266] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:35 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:36.789663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-081ebfcc-b661-4642-8fa0-9a0251d5f789 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:36.790379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-081ebfcc-b661-4642-8fa0-9a0251d5f789 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:36.798766 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-081ebfcc-b661-4642-8fa0-9a0251d5f789 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:36.799322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-081ebfcc-b661-4642-8fa0-9a0251d5f789 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:36.800156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-081ebfcc-b661-4642-8fa0-9a0251d5f789 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:36.800651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-081ebfcc-b661-4642-8fa0-9a0251d5f789 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:36.924237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-081ebfcc-b661-4642-8fa0-9a0251d5f789 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:36.933024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-081ebfcc-b661-4642-8fa0-9a0251d5f789 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147410 Apr 19 03:52:36.933640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 609/1267] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:36 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:37.951856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-05e26db4-b957-4f52-9ab0-a3f9dd7e7677 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:37.952523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-05e26db4-b957-4f52-9ab0-a3f9dd7e7677 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:37.960966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05e26db4-b957-4f52-9ab0-a3f9dd7e7677 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:37.961463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05e26db4-b957-4f52-9ab0-a3f9dd7e7677 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:37.962285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05e26db4-b957-4f52-9ab0-a3f9dd7e7677 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:37.962770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05e26db4-b957-4f52-9ab0-a3f9dd7e7677 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:38.086181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-05e26db4-b957-4f52-9ab0-a3f9dd7e7677 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:38.094912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-05e26db4-b957-4f52-9ab0-a3f9dd7e7677 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147115 Apr 19 03:52:38.095576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 659/1268] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:37 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:39.192668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b505ccab-3f15-4fab-a67f-ebca98fffc31 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:39.193342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b505ccab-3f15-4fab-a67f-ebca98fffc31 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:39.201322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b505ccab-3f15-4fab-a67f-ebca98fffc31 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:39.201853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b505ccab-3f15-4fab-a67f-ebca98fffc31 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:39.202665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b505ccab-3f15-4fab-a67f-ebca98fffc31 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:39.203192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b505ccab-3f15-4fab-a67f-ebca98fffc31 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:39.327622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b505ccab-3f15-4fab-a67f-ebca98fffc31 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:39.337623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b505ccab-3f15-4fab-a67f-ebca98fffc31 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.228774 Apr 19 03:52:39.338240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 610/1269] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:39 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:40.355646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-052c8d6e-5bb7-4969-993d-8f3d8ccdd0b4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:40.356324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-052c8d6e-5bb7-4969-993d-8f3d8ccdd0b4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:40.364786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-052c8d6e-5bb7-4969-993d-8f3d8ccdd0b4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:40.365296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-052c8d6e-5bb7-4969-993d-8f3d8ccdd0b4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:40.366129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-052c8d6e-5bb7-4969-993d-8f3d8ccdd0b4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:40.366625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-052c8d6e-5bb7-4969-993d-8f3d8ccdd0b4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:40.490916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-052c8d6e-5bb7-4969-993d-8f3d8ccdd0b4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:40.500075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-052c8d6e-5bb7-4969-993d-8f3d8ccdd0b4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148588 Apr 19 03:52:40.500697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 660/1270] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:40 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:41.518497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c90bf57b-04c3-4ae7-87ea-be8a23a031a4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:41.519193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c90bf57b-04c3-4ae7-87ea-be8a23a031a4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:41.527032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c90bf57b-04c3-4ae7-87ea-be8a23a031a4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:41.527624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c90bf57b-04c3-4ae7-87ea-be8a23a031a4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:41.528451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c90bf57b-04c3-4ae7-87ea-be8a23a031a4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:41.528945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c90bf57b-04c3-4ae7-87ea-be8a23a031a4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:41.650426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c90bf57b-04c3-4ae7-87ea-be8a23a031a4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:41.659750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c90bf57b-04c3-4ae7-87ea-be8a23a031a4 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145434 Apr 19 03:52:41.660368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 611/1271] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:41 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:42.678223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1e1cc127-c1ba-4445-a9f2-c7f17ec052f7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:42.678891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1e1cc127-c1ba-4445-a9f2-c7f17ec052f7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:42.686651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e1cc127-c1ba-4445-a9f2-c7f17ec052f7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:42.687189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e1cc127-c1ba-4445-a9f2-c7f17ec052f7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:42.688620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e1cc127-c1ba-4445-a9f2-c7f17ec052f7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:42.689107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e1cc127-c1ba-4445-a9f2-c7f17ec052f7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:42.809217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1e1cc127-c1ba-4445-a9f2-c7f17ec052f7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:42.818570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1e1cc127-c1ba-4445-a9f2-c7f17ec052f7 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.144464 Apr 19 03:52:42.819209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 661/1272] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:42 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:43.836639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c1d2842c-628b-4db3-a305-02280eb8c6c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:43.837348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c1d2842c-628b-4db3-a305-02280eb8c6c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:43.845398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1d2842c-628b-4db3-a305-02280eb8c6c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:43.845849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1d2842c-628b-4db3-a305-02280eb8c6c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:43.846748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1d2842c-628b-4db3-a305-02280eb8c6c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:43.847259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1d2842c-628b-4db3-a305-02280eb8c6c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:43.971663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c1d2842c-628b-4db3-a305-02280eb8c6c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:43.980417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c1d2842c-628b-4db3-a305-02280eb8c6c6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147941 Apr 19 03:52:43.981034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 612/1273] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:43 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:44.998988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5c5aa5af-21fb-45f9-ae96-8c62ed7acb29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:44.999695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5c5aa5af-21fb-45f9-ae96-8c62ed7acb29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:45.007550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c5aa5af-21fb-45f9-ae96-8c62ed7acb29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:45.008060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c5aa5af-21fb-45f9-ae96-8c62ed7acb29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:45.008884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c5aa5af-21fb-45f9-ae96-8c62ed7acb29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:45.009372 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c5aa5af-21fb-45f9-ae96-8c62ed7acb29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:45.132724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5c5aa5af-21fb-45f9-ae96-8c62ed7acb29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:45.142025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5c5aa5af-21fb-45f9-ae96-8c62ed7acb29 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147320 Apr 19 03:52:45.142649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 662/1274] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:44 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:46.160594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-75288f1f-fc08-474e-a559-5eb1431065b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:46.161268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-75288f1f-fc08-474e-a559-5eb1431065b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:46.169091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75288f1f-fc08-474e-a559-5eb1431065b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:46.169597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75288f1f-fc08-474e-a559-5eb1431065b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:46.170426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75288f1f-fc08-474e-a559-5eb1431065b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:46.170917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75288f1f-fc08-474e-a559-5eb1431065b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:46.295828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-75288f1f-fc08-474e-a559-5eb1431065b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:46.305401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-75288f1f-fc08-474e-a559-5eb1431065b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149397 Apr 19 03:52:46.306019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 613/1275] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:46 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:47.323454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e512528e-5f82-4e68-9320-b54adc3163b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:47.324124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e512528e-5f82-4e68-9320-b54adc3163b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:47.332489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e512528e-5f82-4e68-9320-b54adc3163b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:47.332993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e512528e-5f82-4e68-9320-b54adc3163b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:47.333815 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e512528e-5f82-4e68-9320-b54adc3163b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:47.334303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e512528e-5f82-4e68-9320-b54adc3163b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:47.458128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e512528e-5f82-4e68-9320-b54adc3163b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:47.466843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e512528e-5f82-4e68-9320-b54adc3163b3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147547 Apr 19 03:52:47.467516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 663/1276] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:47 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:48.485461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bb5c4508-3c4d-4740-9c8e-367c7b9a5e91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:48.486127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bb5c4508-3c4d-4740-9c8e-367c7b9a5e91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:48.494187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb5c4508-3c4d-4740-9c8e-367c7b9a5e91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:48.494710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb5c4508-3c4d-4740-9c8e-367c7b9a5e91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:48.495561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb5c4508-3c4d-4740-9c8e-367c7b9a5e91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:48.496044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb5c4508-3c4d-4740-9c8e-367c7b9a5e91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:48.621909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bb5c4508-3c4d-4740-9c8e-367c7b9a5e91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:48.631611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bb5c4508-3c4d-4740-9c8e-367c7b9a5e91 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.150322 Apr 19 03:52:48.632227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 614/1277] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:48 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:49.649790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1568e94b-5927-4801-88f9-cd8de37c6ec2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:49.650466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1568e94b-5927-4801-88f9-cd8de37c6ec2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:49.658358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1568e94b-5927-4801-88f9-cd8de37c6ec2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:49.658864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1568e94b-5927-4801-88f9-cd8de37c6ec2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:49.659719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1568e94b-5927-4801-88f9-cd8de37c6ec2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:49.660211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1568e94b-5927-4801-88f9-cd8de37c6ec2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:49.781221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1568e94b-5927-4801-88f9-cd8de37c6ec2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:49.790600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1568e94b-5927-4801-88f9-cd8de37c6ec2 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145000 Apr 19 03:52:49.791233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 664/1278] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:49 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:50.809375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-da32847e-254b-4070-b016-8ee587603978 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:50.810046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-da32847e-254b-4070-b016-8ee587603978 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:50.818445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da32847e-254b-4070-b016-8ee587603978 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:50.818949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da32847e-254b-4070-b016-8ee587603978 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:50.819832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da32847e-254b-4070-b016-8ee587603978 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:50.820328 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da32847e-254b-4070-b016-8ee587603978 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:50.944260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-da32847e-254b-4070-b016-8ee587603978 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:50.953188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-da32847e-254b-4070-b016-8ee587603978 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147956 Apr 19 03:52:50.953810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 615/1279] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:50 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:51.971509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c5268cd8-c1b0-4814-b089-d96ed9bf3c48 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:51.972186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c5268cd8-c1b0-4814-b089-d96ed9bf3c48 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:51.979979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5268cd8-c1b0-4814-b089-d96ed9bf3c48 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:51.980484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5268cd8-c1b0-4814-b089-d96ed9bf3c48 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:51.981307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5268cd8-c1b0-4814-b089-d96ed9bf3c48 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:51.981791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5268cd8-c1b0-4814-b089-d96ed9bf3c48 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:52.105675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c5268cd8-c1b0-4814-b089-d96ed9bf3c48 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:52.114352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c5268cd8-c1b0-4814-b089-d96ed9bf3c48 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147210 Apr 19 03:52:52.114963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 665/1280] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:51 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:53.133384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c5e59d6a-5169-486c-9c37-45be89151b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:53.134111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c5e59d6a-5169-486c-9c37-45be89151b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:53.142041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5e59d6a-5169-486c-9c37-45be89151b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:53.142581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5e59d6a-5169-486c-9c37-45be89151b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:53.143447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5e59d6a-5169-486c-9c37-45be89151b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:53.143944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c5e59d6a-5169-486c-9c37-45be89151b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:53.269510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c5e59d6a-5169-486c-9c37-45be89151b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:53.278280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c5e59d6a-5169-486c-9c37-45be89151b22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149105 Apr 19 03:52:53.278900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 616/1281] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:53 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:54.296058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ee7771d3-6c67-4fed-ab3e-3b963dd84498 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:54.296725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ee7771d3-6c67-4fed-ab3e-3b963dd84498 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:54.304519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee7771d3-6c67-4fed-ab3e-3b963dd84498 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:54.305020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee7771d3-6c67-4fed-ab3e-3b963dd84498 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:54.305862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee7771d3-6c67-4fed-ab3e-3b963dd84498 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:54.306326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee7771d3-6c67-4fed-ab3e-3b963dd84498 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:54.430677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ee7771d3-6c67-4fed-ab3e-3b963dd84498 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:54.441764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ee7771d3-6c67-4fed-ab3e-3b963dd84498 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149836 Apr 19 03:52:54.442395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 666/1282] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:54 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:55.459926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6fe293e1-cc09-4141-b2ff-91791e94a51a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:55.460592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6fe293e1-cc09-4141-b2ff-91791e94a51a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:55.468402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6fe293e1-cc09-4141-b2ff-91791e94a51a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:55.468902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6fe293e1-cc09-4141-b2ff-91791e94a51a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:55.469720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6fe293e1-cc09-4141-b2ff-91791e94a51a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:55.470205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6fe293e1-cc09-4141-b2ff-91791e94a51a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:55.592007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6fe293e1-cc09-4141-b2ff-91791e94a51a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:55.601716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6fe293e1-cc09-4141-b2ff-91791e94a51a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146526 Apr 19 03:52:55.602341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 617/1283] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:55 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:56.619860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5406c78e-2e9d-472f-a63c-5a730176ac9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:56.620536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5406c78e-2e9d-472f-a63c-5a730176ac9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:56.628449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5406c78e-2e9d-472f-a63c-5a730176ac9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:56.628959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5406c78e-2e9d-472f-a63c-5a730176ac9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:56.629791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5406c78e-2e9d-472f-a63c-5a730176ac9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:56.630284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5406c78e-2e9d-472f-a63c-5a730176ac9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:56.751580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5406c78e-2e9d-472f-a63c-5a730176ac9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:56.760362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5406c78e-2e9d-472f-a63c-5a730176ac9d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.144934 Apr 19 03:52:56.760976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 667/1284] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:56 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:57.778276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-47d9b284-6b52-467c-97f7-00b81e5e284f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:57.779070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-47d9b284-6b52-467c-97f7-00b81e5e284f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:57.786942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47d9b284-6b52-467c-97f7-00b81e5e284f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:57.788301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47d9b284-6b52-467c-97f7-00b81e5e284f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:57.788591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47d9b284-6b52-467c-97f7-00b81e5e284f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:57.788832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-47d9b284-6b52-467c-97f7-00b81e5e284f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:57.912221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-47d9b284-6b52-467c-97f7-00b81e5e284f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:57.920852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-47d9b284-6b52-467c-97f7-00b81e5e284f tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146700 Apr 19 03:52:57.921470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 618/1285] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:57 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:52:58.939877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8937e2d2-4c9b-404c-872f-87e0ad676875 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:52:58.940541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8937e2d2-4c9b-404c-872f-87e0ad676875 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:52:58.948296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8937e2d2-4c9b-404c-872f-87e0ad676875 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:58.948798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8937e2d2-4c9b-404c-872f-87e0ad676875 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:58.949613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8937e2d2-4c9b-404c-872f-87e0ad676875 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:52:58.950102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8937e2d2-4c9b-404c-872f-87e0ad676875 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:52:59.074239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8937e2d2-4c9b-404c-872f-87e0ad676875 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:52:59.082968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8937e2d2-4c9b-404c-872f-87e0ad676875 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147785 Apr 19 03:52:59.083612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 668/1286] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:52:58 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:00.101771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-abd89510-3aa6-4a2b-938c-289ebfc89ee3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:00.102488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-abd89510-3aa6-4a2b-938c-289ebfc89ee3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:00.110453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-abd89510-3aa6-4a2b-938c-289ebfc89ee3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:00.110991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-abd89510-3aa6-4a2b-938c-289ebfc89ee3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:00.111866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-abd89510-3aa6-4a2b-938c-289ebfc89ee3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:00.112358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-abd89510-3aa6-4a2b-938c-289ebfc89ee3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:00.236369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-abd89510-3aa6-4a2b-938c-289ebfc89ee3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:00.245513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-abd89510-3aa6-4a2b-938c-289ebfc89ee3 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148070 Apr 19 03:53:00.246161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 619/1287] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:00 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:01.264102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f7cbee20-b3a1-47b3-847e-d636dd179147 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:01.264780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f7cbee20-b3a1-47b3-847e-d636dd179147 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:01.273058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7cbee20-b3a1-47b3-847e-d636dd179147 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:01.273564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7cbee20-b3a1-47b3-847e-d636dd179147 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:01.274386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7cbee20-b3a1-47b3-847e-d636dd179147 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:01.274875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7cbee20-b3a1-47b3-847e-d636dd179147 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:01.399915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f7cbee20-b3a1-47b3-847e-d636dd179147 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:01.409206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f7cbee20-b3a1-47b3-847e-d636dd179147 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149273 Apr 19 03:53:01.409814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 669/1288] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:01 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:02.427173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-521f3b14-b9cf-4176-ac58-3c013d238057 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:02.427833 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-521f3b14-b9cf-4176-ac58-3c013d238057 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:02.435623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-521f3b14-b9cf-4176-ac58-3c013d238057 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:02.436129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-521f3b14-b9cf-4176-ac58-3c013d238057 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:02.437036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-521f3b14-b9cf-4176-ac58-3c013d238057 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:02.437523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-521f3b14-b9cf-4176-ac58-3c013d238057 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:02.559768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-521f3b14-b9cf-4176-ac58-3c013d238057 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:02.568810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-521f3b14-b9cf-4176-ac58-3c013d238057 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.146341 Apr 19 03:53:02.569419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 620/1289] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:02 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:03.586851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fc8db3b9-2438-4906-b2f7-78cd377512c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:03.587606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fc8db3b9-2438-4906-b2f7-78cd377512c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:03.595477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc8db3b9-2438-4906-b2f7-78cd377512c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:03.595991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc8db3b9-2438-4906-b2f7-78cd377512c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:03.596825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc8db3b9-2438-4906-b2f7-78cd377512c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:03.597316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc8db3b9-2438-4906-b2f7-78cd377512c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:03.778810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fc8db3b9-2438-4906-b2f7-78cd377512c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:03.787950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fc8db3b9-2438-4906-b2f7-78cd377512c0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.205340 Apr 19 03:53:03.788565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 670/1290] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:03 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:04.806024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e45ebb51-54ff-454f-9140-03d963a5934d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:04.806701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e45ebb51-54ff-454f-9140-03d963a5934d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:04.815184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e45ebb51-54ff-454f-9140-03d963a5934d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:04.815695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e45ebb51-54ff-454f-9140-03d963a5934d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:04.816524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e45ebb51-54ff-454f-9140-03d963a5934d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:04.817065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e45ebb51-54ff-454f-9140-03d963a5934d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:04.987216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e45ebb51-54ff-454f-9140-03d963a5934d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:04.996353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e45ebb51-54ff-454f-9140-03d963a5934d tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.194453 Apr 19 03:53:04.996971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 621/1291] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:04 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:06.014748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-292b6bdc-9d7b-43fe-bb77-d1c9d8819682 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:06.015452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-292b6bdc-9d7b-43fe-bb77-d1c9d8819682 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:06.023840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-292b6bdc-9d7b-43fe-bb77-d1c9d8819682 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:06.024353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-292b6bdc-9d7b-43fe-bb77-d1c9d8819682 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:06.025181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-292b6bdc-9d7b-43fe-bb77-d1c9d8819682 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:06.025681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-292b6bdc-9d7b-43fe-bb77-d1c9d8819682 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:06.149724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-292b6bdc-9d7b-43fe-bb77-d1c9d8819682 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:06.159110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-292b6bdc-9d7b-43fe-bb77-d1c9d8819682 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148446 Apr 19 03:53:06.159771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 671/1292] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:06 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:06.784951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:53:06.785128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:53:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:53:07.105039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:53:07.105474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:53:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:53:07.176949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8089ceac-b7cb-447b-9a94-af6af17808e5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:07.177566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8089ceac-b7cb-447b-9a94-af6af17808e5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:07.185487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8089ceac-b7cb-447b-9a94-af6af17808e5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:07.185995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8089ceac-b7cb-447b-9a94-af6af17808e5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:07.186819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8089ceac-b7cb-447b-9a94-af6af17808e5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:07.187343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8089ceac-b7cb-447b-9a94-af6af17808e5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:07.312527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8089ceac-b7cb-447b-9a94-af6af17808e5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:07.321394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8089ceac-b7cb-447b-9a94-af6af17808e5 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149081 Apr 19 03:53:07.322005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 622/1293] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:07 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:08.056101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:53:08.056255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:53:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:53:08.339900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d4c46ebc-135a-4bc8-bdd8-375e1e766d59 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:08.340510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d4c46ebc-135a-4bc8-bdd8-375e1e766d59 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:08.348405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d4c46ebc-135a-4bc8-bdd8-375e1e766d59 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:08.348917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d4c46ebc-135a-4bc8-bdd8-375e1e766d59 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:08.349744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d4c46ebc-135a-4bc8-bdd8-375e1e766d59 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:08.350237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d4c46ebc-135a-4bc8-bdd8-375e1e766d59 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:08.475075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d4c46ebc-135a-4bc8-bdd8-375e1e766d59 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:08.483854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d4c46ebc-135a-4bc8-bdd8-375e1e766d59 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148092 Apr 19 03:53:08.484471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 672/1294] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:08 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:09.503684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6f4e56a8-6507-4d0a-906a-35e2edab5dbc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:09.504353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6f4e56a8-6507-4d0a-906a-35e2edab5dbc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:09.512191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f4e56a8-6507-4d0a-906a-35e2edab5dbc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:09.512704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f4e56a8-6507-4d0a-906a-35e2edab5dbc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:09.513538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f4e56a8-6507-4d0a-906a-35e2edab5dbc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:09.514033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f4e56a8-6507-4d0a-906a-35e2edab5dbc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:09.815845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6f4e56a8-6507-4d0a-906a-35e2edab5dbc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:09.815845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6f4e56a8-6507-4d0a-906a-35e2edab5dbc tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148285 Apr 19 03:53:09.815845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 623/1295] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:09 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:10.665887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fd98ae41-a92a-4e1f-90a2-79f34b2947b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:10.666549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fd98ae41-a92a-4e1f-90a2-79f34b2947b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:10.674382 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd98ae41-a92a-4e1f-90a2-79f34b2947b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:10.674884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd98ae41-a92a-4e1f-90a2-79f34b2947b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:10.675736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd98ae41-a92a-4e1f-90a2-79f34b2947b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:10.676223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd98ae41-a92a-4e1f-90a2-79f34b2947b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:10.797417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fd98ae41-a92a-4e1f-90a2-79f34b2947b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:10.806132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fd98ae41-a92a-4e1f-90a2-79f34b2947b9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.144377 Apr 19 03:53:10.806741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 673/1296] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:10 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:11.824817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3ad91f44-973f-419f-ad64-339333dfe626 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:11.825526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3ad91f44-973f-419f-ad64-339333dfe626 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:11.833846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ad91f44-973f-419f-ad64-339333dfe626 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:11.834349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ad91f44-973f-419f-ad64-339333dfe626 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:11.835189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ad91f44-973f-419f-ad64-339333dfe626 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:11.835685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3ad91f44-973f-419f-ad64-339333dfe626 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:11.959045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3ad91f44-973f-419f-ad64-339333dfe626 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:11.967795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3ad91f44-973f-419f-ad64-339333dfe626 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147114 Apr 19 03:53:11.968407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 624/1297] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:11 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:12.987016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-049e23da-db26-47f0-a1a4-58bb48faa514 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:12.987722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-049e23da-db26-47f0-a1a4-58bb48faa514 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:12.995811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-049e23da-db26-47f0-a1a4-58bb48faa514 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:12.996314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-049e23da-db26-47f0-a1a4-58bb48faa514 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:12.997138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-049e23da-db26-47f0-a1a4-58bb48faa514 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:12.997628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-049e23da-db26-47f0-a1a4-58bb48faa514 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:13.120867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-049e23da-db26-47f0-a1a4-58bb48faa514 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:13.129525 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-049e23da-db26-47f0-a1a4-58bb48faa514 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147288 Apr 19 03:53:13.130153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 674/1298] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:12 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:14.148238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8179d9c1-feb8-4b59-ac19-9b9edda0bdb9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:14.148913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8179d9c1-feb8-4b59-ac19-9b9edda0bdb9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:14.156917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8179d9c1-feb8-4b59-ac19-9b9edda0bdb9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:14.157426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8179d9c1-feb8-4b59-ac19-9b9edda0bdb9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:14.158871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8179d9c1-feb8-4b59-ac19-9b9edda0bdb9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:14.159409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8179d9c1-feb8-4b59-ac19-9b9edda0bdb9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:14.284274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8179d9c1-feb8-4b59-ac19-9b9edda0bdb9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:14.293269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8179d9c1-feb8-4b59-ac19-9b9edda0bdb9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.149166 Apr 19 03:53:14.298236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 625/1299] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:14 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:15.311548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d77ea7d1-8e04-471f-9cbf-9e2c22aa70ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:15.312256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d77ea7d1-8e04-471f-9cbf-9e2c22aa70ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:15.320127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d77ea7d1-8e04-471f-9cbf-9e2c22aa70ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:15.320640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d77ea7d1-8e04-471f-9cbf-9e2c22aa70ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:15.321468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d77ea7d1-8e04-471f-9cbf-9e2c22aa70ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:15.321964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d77ea7d1-8e04-471f-9cbf-9e2c22aa70ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:15.446999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d77ea7d1-8e04-471f-9cbf-9e2c22aa70ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:15.455760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d77ea7d1-8e04-471f-9cbf-9e2c22aa70ee tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148559 Apr 19 03:53:15.456369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 675/1300] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:15 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:16.473887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4497e82e-103e-4419-a29f-e09a40e9fc22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:16.474551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4497e82e-103e-4419-a29f-e09a40e9fc22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:16.482479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4497e82e-103e-4419-a29f-e09a40e9fc22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:16.482980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4497e82e-103e-4419-a29f-e09a40e9fc22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:16.483854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4497e82e-103e-4419-a29f-e09a40e9fc22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:16.484344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4497e82e-103e-4419-a29f-e09a40e9fc22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:16.606171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4497e82e-103e-4419-a29f-e09a40e9fc22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:16.615700 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4497e82e-103e-4419-a29f-e09a40e9fc22 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.145966 Apr 19 03:53:16.616322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 626/1301] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:16 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:17.634152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ea1f548d-3f79-41fb-b523-da1a31943a6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:17.634819 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ea1f548d-3f79-41fb-b523-da1a31943a6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:17.642670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea1f548d-3f79-41fb-b523-da1a31943a6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:17.643191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea1f548d-3f79-41fb-b523-da1a31943a6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:17.644065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea1f548d-3f79-41fb-b523-da1a31943a6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:17.644552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea1f548d-3f79-41fb-b523-da1a31943a6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:17.765775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea1f548d-3f79-41fb-b523-da1a31943a6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:17.774530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ea1f548d-3f79-41fb-b523-da1a31943a6a tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.144573 Apr 19 03:53:17.775181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 676/1302] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:17 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:18.793071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b895eb52-67a0-4484-be61-553b672a831e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:18.793746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b895eb52-67a0-4484-be61-553b672a831e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:18.802157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b895eb52-67a0-4484-be61-553b672a831e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:18.802666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b895eb52-67a0-4484-be61-553b672a831e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:18.803523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b895eb52-67a0-4484-be61-553b672a831e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:18.804012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b895eb52-67a0-4484-be61-553b672a831e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:18.928993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b895eb52-67a0-4484-be61-553b672a831e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:18.937780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b895eb52-67a0-4484-be61-553b672a831e tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.148786 Apr 19 03:53:18.938389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 627/1303] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:18 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:19.956966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0636f13b-dbbb-49a2-a0ce-fceb6337e611 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:19.957640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0636f13b-dbbb-49a2-a0ce-fceb6337e611 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:19.965580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0636f13b-dbbb-49a2-a0ce-fceb6337e611 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:19.966095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0636f13b-dbbb-49a2-a0ce-fceb6337e611 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:19.966921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0636f13b-dbbb-49a2-a0ce-fceb6337e611 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:19.967438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0636f13b-dbbb-49a2-a0ce-fceb6337e611 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:20.090876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0636f13b-dbbb-49a2-a0ce-fceb6337e611 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:20.099622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0636f13b-dbbb-49a2-a0ce-fceb6337e611 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.147376 Apr 19 03:53:20.100237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 677/1304] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:19 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:21.117743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c4de0512-5837-41f2-a3a6-3d73284be6a9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:21.118422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c4de0512-5837-41f2-a3a6-3d73284be6a9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:21.126310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c4de0512-5837-41f2-a3a6-3d73284be6a9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:21.126820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c4de0512-5837-41f2-a3a6-3d73284be6a9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:21.127684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c4de0512-5837-41f2-a3a6-3d73284be6a9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:21.128175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c4de0512-5837-41f2-a3a6-3d73284be6a9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:21.255235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c4de0512-5837-41f2-a3a6-3d73284be6a9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:21.264379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c4de0512-5837-41f2-a3a6-3d73284be6a9 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.150955 Apr 19 03:53:21.265004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 628/1305] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:21 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:22.283786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3a8c39a1-94a1-4e23-a8f9-166fa1d91f1c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:22.284473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3a8c39a1-94a1-4e23-a8f9-166fa1d91f1c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:22.292453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a8c39a1-94a1-4e23-a8f9-166fa1d91f1c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:22.292925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a8c39a1-94a1-4e23-a8f9-166fa1d91f1c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:22.293763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a8c39a1-94a1-4e23-a8f9-166fa1d91f1c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:22.294303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a8c39a1-94a1-4e23-a8f9-166fa1d91f1c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:22.423379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3a8c39a1-94a1-4e23-a8f9-166fa1d91f1c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7857d2962cae4aed923735a1ebe781f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9685547739384db983b365ae780e9d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:22.432383 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3a8c39a1-94a1-4e23-a8f9-166fa1d91f1c tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 200 len: 1219 microversion: 2.1 time: 0.153170 Apr 19 03:53:22.433008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 678/1306] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:22 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:23.449981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3eb7a90b-7e69-414c-a927-b35f13a7f6d0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:23.450655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3eb7a90b-7e69-414c-a927-b35f13a7f6d0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] [instance: 3cc5cf11-07e5-4749-b662-5d41fef38609] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:23.458453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3eb7a90b-7e69-414c-a927-b35f13a7f6d0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:23.458957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3eb7a90b-7e69-414c-a927-b35f13a7f6d0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:23.459799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3eb7a90b-7e69-414c-a927-b35f13a7f6d0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:23.460283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3eb7a90b-7e69-414c-a927-b35f13a7f6d0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:23.512725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-3eb7a90b-7e69-414c-a927-b35f13a7f6d0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] HTTP exception thrown: Instance 3cc5cf11-07e5-4749-b662-5d41fef38609 could not be found. Apr 19 03:53:23.513376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3eb7a90b-7e69-414c-a927-b35f13a7f6d0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Returning 404 to user: Instance 3cc5cf11-07e5-4749-b662-5d41fef38609 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:53:23.514248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3eb7a90b-7e69-414c-a927-b35f13a7f6d0 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609" status: 404 len: 111 microversion: 2.1 time: 0.068454 Apr 19 03:53:23.514817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 629/1307] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:23 2021] GET /compute/v2.1/servers/3cc5cf11-07e5-4749-b662-5d41fef38609 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:53:23.770451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8bc020a3-a621-47a1-9046-38762dc481a6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] Calling method '.version_select at 0x7f9dac55e7b8>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:23.843805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8bc020a3-a621-47a1-9046-38762dc481a6 tempest-TestShelveInstance-1488877498 tempest-TestShelveInstance-1488877498-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-289167008" status: 202 len: 0 microversion: 2.1 time: 0.077366 Apr 19 03:53:23.844472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 679/1308] 10.222.0.25 () {58 vars in 1241 bytes} [Mon Apr 19 03:53:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-289167008 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:53:26.400844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:53:26.401402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:53:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:53:40.868843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ed232b62-27e1-4c41-92df-c8038af7347c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:40.869379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ed232b62-27e1-4c41-92df-c8038af7347c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:40.877466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ed232b62-27e1-4c41-92df-c8038af7347c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:40.877964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ed232b62-27e1-4c41-92df-c8038af7347c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:40.878789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ed232b62-27e1-4c41-92df-c8038af7347c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:40.879310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ed232b62-27e1-4c41-92df-c8038af7347c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:40.947256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ed232b62-27e1-4c41-92df-c8038af7347c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:53:41.349309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ed232b62-27e1-4c41-92df-c8038af7347c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 204 len: 0 microversion: 2.1 time: 0.484589 Apr 19 03:53:41.350037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 630/1309] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:53:40 2021] DELETE /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:53:41.358829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-587e8327-a725-4980-8433-dc4b76111f49 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:41.365784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-587e8327-a725-4980-8433-dc4b76111f49 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:41.368410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-587e8327-a725-4980-8433-dc4b76111f49 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:41.368956 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-587e8327-a725-4980-8433-dc4b76111f49 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:41.369712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-587e8327-a725-4980-8433-dc4b76111f49 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:41.370200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-587e8327-a725-4980-8433-dc4b76111f49 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:41.586271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-587e8327-a725-4980-8433-dc4b76111f49 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:41.595908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-587e8327-a725-4980-8433-dc4b76111f49 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1600 microversion: 2.1 time: 0.241318 Apr 19 03:53:41.596533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 680/1310] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:41 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1600 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:42.614581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9cdb9392-f939-4fdc-9740-f22a1b89d02d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:42.615408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9cdb9392-f939-4fdc-9740-f22a1b89d02d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:42.624017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9cdb9392-f939-4fdc-9740-f22a1b89d02d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:42.624524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9cdb9392-f939-4fdc-9740-f22a1b89d02d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:42.625351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9cdb9392-f939-4fdc-9740-f22a1b89d02d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:42.625875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9cdb9392-f939-4fdc-9740-f22a1b89d02d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:42.789097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9cdb9392-f939-4fdc-9740-f22a1b89d02d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:42.798609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9cdb9392-f939-4fdc-9740-f22a1b89d02d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1558 microversion: 2.1 time: 0.188812 Apr 19 03:53:42.807131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 631/1311] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:42 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:42.860127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-f8d73333-ff7e-4f8b-9aaa-6e523e333056 req-4b6e8999-7771-455b-9eff-1d9ce8e179df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eebf65c-de9c-4548-aab3-63d7c52a229c", "name": "network-vif-deleted", "tag": "589d1f32-cd4b-4443-9982-41cdb9265434"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:53:42.862066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:53:42.862066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:53:42.871244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-f8d73333-ff7e-4f8b-9aaa-6e523e333056 req-4b6e8999-7771-455b-9eff-1d9ce8e179df service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:42.879919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-f8d73333-ff7e-4f8b-9aaa-6e523e333056 req-4b6e8999-7771-455b-9eff-1d9ce8e179df service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:42.888583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-f8d73333-ff7e-4f8b-9aaa-6e523e333056 req-4b6e8999-7771-455b-9eff-1d9ce8e179df service nova] Creating event network-vif-deleted:589d1f32-cd4b-4443-9982-41cdb9265434 for instance 0eebf65c-de9c-4548-aab3-63d7c52a229c on hv-cinder-78605 Apr 19 03:53:42.895214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-f8d73333-ff7e-4f8b-9aaa-6e523e333056 req-4b6e8999-7771-455b-9eff-1d9ce8e179df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039164 Apr 19 03:53:42.895841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 681/1312] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:53:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:53:43.817080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-00f02b0d-cd9a-4df5-b64e-1a927a4d8f78 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:43.817747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-00f02b0d-cd9a-4df5-b64e-1a927a4d8f78 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:43.825558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00f02b0d-cd9a-4df5-b64e-1a927a4d8f78 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:43.826053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00f02b0d-cd9a-4df5-b64e-1a927a4d8f78 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:43.826868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00f02b0d-cd9a-4df5-b64e-1a927a4d8f78 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:43.827384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00f02b0d-cd9a-4df5-b64e-1a927a4d8f78 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:43.953161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-00f02b0d-cd9a-4df5-b64e-1a927a4d8f78 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:43.962395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-00f02b0d-cd9a-4df5-b64e-1a927a4d8f78 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.149554 Apr 19 03:53:43.962999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 632/1313] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:43 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:44.981961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6f2cca71-b5a6-4d25-9221-c64dd5909a02 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:44.982740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6f2cca71-b5a6-4d25-9221-c64dd5909a02 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:44.991486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f2cca71-b5a6-4d25-9221-c64dd5909a02 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:44.991997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f2cca71-b5a6-4d25-9221-c64dd5909a02 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:44.993097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f2cca71-b5a6-4d25-9221-c64dd5909a02 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:44.993642 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f2cca71-b5a6-4d25-9221-c64dd5909a02 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:45.162952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6f2cca71-b5a6-4d25-9221-c64dd5909a02 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:45.172972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6f2cca71-b5a6-4d25-9221-c64dd5909a02 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.195088 Apr 19 03:53:45.173594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 682/1314] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:44 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:46.191552 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-37b99874-f1b8-479f-8e16-57b268fd67af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:46.192260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-37b99874-f1b8-479f-8e16-57b268fd67af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:46.200070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37b99874-f1b8-479f-8e16-57b268fd67af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:46.200572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37b99874-f1b8-479f-8e16-57b268fd67af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:46.201392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37b99874-f1b8-479f-8e16-57b268fd67af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:46.201872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37b99874-f1b8-479f-8e16-57b268fd67af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:46.323771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-37b99874-f1b8-479f-8e16-57b268fd67af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:46.333418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-37b99874-f1b8-479f-8e16-57b268fd67af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146554 Apr 19 03:53:46.334020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 633/1315] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:46 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:47.351310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3d160970-06ba-41fe-9fcb-679fbdd78290 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:47.352009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3d160970-06ba-41fe-9fcb-679fbdd78290 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:47.360379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d160970-06ba-41fe-9fcb-679fbdd78290 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:47.360888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d160970-06ba-41fe-9fcb-679fbdd78290 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:47.361719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d160970-06ba-41fe-9fcb-679fbdd78290 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:47.362202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d160970-06ba-41fe-9fcb-679fbdd78290 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:47.486834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3d160970-06ba-41fe-9fcb-679fbdd78290 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:47.496295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3d160970-06ba-41fe-9fcb-679fbdd78290 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.149120 Apr 19 03:53:47.496911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 683/1316] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:47 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:48.514533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cf57e716-2e69-42a1-aa37-424fb22cf72a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:48.515228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cf57e716-2e69-42a1-aa37-424fb22cf72a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:48.523677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf57e716-2e69-42a1-aa37-424fb22cf72a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:48.524183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf57e716-2e69-42a1-aa37-424fb22cf72a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:48.525010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf57e716-2e69-42a1-aa37-424fb22cf72a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:48.525506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf57e716-2e69-42a1-aa37-424fb22cf72a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:48.647272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cf57e716-2e69-42a1-aa37-424fb22cf72a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:48.656742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cf57e716-2e69-42a1-aa37-424fb22cf72a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146325 Apr 19 03:53:48.657359 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 634/1317] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:48 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:49.674101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2f306758-2cf5-4d56-949c-f4bc25fd6ca3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:49.674768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2f306758-2cf5-4d56-949c-f4bc25fd6ca3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:49.682626 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f306758-2cf5-4d56-949c-f4bc25fd6ca3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:49.683131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f306758-2cf5-4d56-949c-f4bc25fd6ca3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:49.684000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f306758-2cf5-4d56-949c-f4bc25fd6ca3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:49.684484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f306758-2cf5-4d56-949c-f4bc25fd6ca3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:49.805795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2f306758-2cf5-4d56-949c-f4bc25fd6ca3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:49.815518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2f306758-2cf5-4d56-949c-f4bc25fd6ca3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145471 Apr 19 03:53:49.816129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 684/1318] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:49 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:50.833635 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c3268f48-6b92-41d6-a9d7-851ceef0544c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:50.834260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c3268f48-6b92-41d6-a9d7-851ceef0544c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:50.842136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3268f48-6b92-41d6-a9d7-851ceef0544c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:50.842644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3268f48-6b92-41d6-a9d7-851ceef0544c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:50.843497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3268f48-6b92-41d6-a9d7-851ceef0544c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:50.843989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3268f48-6b92-41d6-a9d7-851ceef0544c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:50.970631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c3268f48-6b92-41d6-a9d7-851ceef0544c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:50.980008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c3268f48-6b92-41d6-a9d7-851ceef0544c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.150588 Apr 19 03:53:50.980616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 635/1319] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:50 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:51.998792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9f3e7911-200a-451a-90f1-a75ab6b73b65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:51.999493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9f3e7911-200a-451a-90f1-a75ab6b73b65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:52.007845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9f3e7911-200a-451a-90f1-a75ab6b73b65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:52.008351 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9f3e7911-200a-451a-90f1-a75ab6b73b65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:52.009176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9f3e7911-200a-451a-90f1-a75ab6b73b65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:52.009665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9f3e7911-200a-451a-90f1-a75ab6b73b65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:52.132620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9f3e7911-200a-451a-90f1-a75ab6b73b65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:52.142509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9f3e7911-200a-451a-90f1-a75ab6b73b65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147837 Apr 19 03:53:52.143131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 685/1320] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:51 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:53.160594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4ff0cd23-3314-41b0-9eb9-b7681f34ddbf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:53.161214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4ff0cd23-3314-41b0-9eb9-b7681f34ddbf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:53.169104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ff0cd23-3314-41b0-9eb9-b7681f34ddbf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:53.169611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ff0cd23-3314-41b0-9eb9-b7681f34ddbf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:53.170434 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ff0cd23-3314-41b0-9eb9-b7681f34ddbf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:53.170920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4ff0cd23-3314-41b0-9eb9-b7681f34ddbf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:53.293791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4ff0cd23-3314-41b0-9eb9-b7681f34ddbf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:53.303474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4ff0cd23-3314-41b0-9eb9-b7681f34ddbf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147567 Apr 19 03:53:53.304090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 636/1321] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:53 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:54.321678 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8ed2ea5d-8307-4040-8005-5edb13c55cea tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:54.324341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8ed2ea5d-8307-4040-8005-5edb13c55cea tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:54.330265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ed2ea5d-8307-4040-8005-5edb13c55cea tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:54.330767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ed2ea5d-8307-4040-8005-5edb13c55cea tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:54.332232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ed2ea5d-8307-4040-8005-5edb13c55cea tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:54.332729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ed2ea5d-8307-4040-8005-5edb13c55cea tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:54.597761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8ed2ea5d-8307-4040-8005-5edb13c55cea tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:54.607443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8ed2ea5d-8307-4040-8005-5edb13c55cea tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.289818 Apr 19 03:53:54.608061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 686/1322] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:54 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:55.626173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-50587db4-f9a8-481a-bc08-d1f61260643d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:55.626782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-50587db4-f9a8-481a-bc08-d1f61260643d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:55.634665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50587db4-f9a8-481a-bc08-d1f61260643d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:55.635194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50587db4-f9a8-481a-bc08-d1f61260643d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:55.636057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50587db4-f9a8-481a-bc08-d1f61260643d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:55.636549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50587db4-f9a8-481a-bc08-d1f61260643d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:55.758393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-50587db4-f9a8-481a-bc08-d1f61260643d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:55.767689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-50587db4-f9a8-481a-bc08-d1f61260643d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146312 Apr 19 03:53:55.768307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 637/1323] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:55 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:56.786070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ac296585-78fd-4d8f-999a-52dc0c9e40de tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:56.786781 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ac296585-78fd-4d8f-999a-52dc0c9e40de tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:56.794576 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ac296585-78fd-4d8f-999a-52dc0c9e40de tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:56.795087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ac296585-78fd-4d8f-999a-52dc0c9e40de tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:56.795946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ac296585-78fd-4d8f-999a-52dc0c9e40de tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:56.796440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ac296585-78fd-4d8f-999a-52dc0c9e40de tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:56.917561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ac296585-78fd-4d8f-999a-52dc0c9e40de tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:56.927410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ac296585-78fd-4d8f-999a-52dc0c9e40de tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145349 Apr 19 03:53:56.928026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 687/1324] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:56 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:57.947584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-22a4814c-7404-44d8-8b56-fc66631d545a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:57.948299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-22a4814c-7404-44d8-8b56-fc66631d545a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:57.956595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22a4814c-7404-44d8-8b56-fc66631d545a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:57.957094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22a4814c-7404-44d8-8b56-fc66631d545a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:57.957917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22a4814c-7404-44d8-8b56-fc66631d545a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:57.958401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22a4814c-7404-44d8-8b56-fc66631d545a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:58.085013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-22a4814c-7404-44d8-8b56-fc66631d545a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:58.094190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-22a4814c-7404-44d8-8b56-fc66631d545a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.150772 Apr 19 03:53:58.094805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 638/1325] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:57 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:53:59.111834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3d8aface-8d49-4796-b682-9f8f8e79c2d3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:53:59.112503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3d8aface-8d49-4796-b682-9f8f8e79c2d3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:53:59.120707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d8aface-8d49-4796-b682-9f8f8e79c2d3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:59.121211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d8aface-8d49-4796-b682-9f8f8e79c2d3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:59.122030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d8aface-8d49-4796-b682-9f8f8e79c2d3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:53:59.122519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d8aface-8d49-4796-b682-9f8f8e79c2d3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:53:59.246853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3d8aface-8d49-4796-b682-9f8f8e79c2d3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:53:59.256149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3d8aface-8d49-4796-b682-9f8f8e79c2d3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.148399 Apr 19 03:53:59.256770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 688/1326] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:53:59 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:00.274607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dcfb62d9-0c4e-4ec8-8f69-bd06ce7c3734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:00.275297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dcfb62d9-0c4e-4ec8-8f69-bd06ce7c3734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:00.283689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dcfb62d9-0c4e-4ec8-8f69-bd06ce7c3734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:00.284213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dcfb62d9-0c4e-4ec8-8f69-bd06ce7c3734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:00.285007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dcfb62d9-0c4e-4ec8-8f69-bd06ce7c3734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:00.285492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dcfb62d9-0c4e-4ec8-8f69-bd06ce7c3734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:00.407613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dcfb62d9-0c4e-4ec8-8f69-bd06ce7c3734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:00.416893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dcfb62d9-0c4e-4ec8-8f69-bd06ce7c3734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146411 Apr 19 03:54:00.417512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 639/1327] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:00 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:01.435464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-92f881e6-a986-4104-87a9-2ecc79978c25 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:01.436136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-92f881e6-a986-4104-87a9-2ecc79978c25 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:01.444566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92f881e6-a986-4104-87a9-2ecc79978c25 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:01.445076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92f881e6-a986-4104-87a9-2ecc79978c25 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:01.445905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92f881e6-a986-4104-87a9-2ecc79978c25 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:01.446395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92f881e6-a986-4104-87a9-2ecc79978c25 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:01.570629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-92f881e6-a986-4104-87a9-2ecc79978c25 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:01.580331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-92f881e6-a986-4104-87a9-2ecc79978c25 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.148976 Apr 19 03:54:01.580982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 689/1328] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:01 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:02.598409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b00d018d-933b-4dc8-aee5-b1d79ff3d12c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:02.599083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b00d018d-933b-4dc8-aee5-b1d79ff3d12c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:02.607063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b00d018d-933b-4dc8-aee5-b1d79ff3d12c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:02.607628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b00d018d-933b-4dc8-aee5-b1d79ff3d12c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:02.608467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b00d018d-933b-4dc8-aee5-b1d79ff3d12c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:02.608967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b00d018d-933b-4dc8-aee5-b1d79ff3d12c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:02.787979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b00d018d-933b-4dc8-aee5-b1d79ff3d12c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:02.797732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b00d018d-933b-4dc8-aee5-b1d79ff3d12c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.203460 Apr 19 03:54:02.798348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 640/1329] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:02 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:03.815694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f9bf01da-df95-4c6f-9d83-3dde1d0ea5d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:03.816370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f9bf01da-df95-4c6f-9d83-3dde1d0ea5d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:03.824155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9bf01da-df95-4c6f-9d83-3dde1d0ea5d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:03.824652 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9bf01da-df95-4c6f-9d83-3dde1d0ea5d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:03.825471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9bf01da-df95-4c6f-9d83-3dde1d0ea5d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:03.825955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f9bf01da-df95-4c6f-9d83-3dde1d0ea5d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:03.945973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f9bf01da-df95-4c6f-9d83-3dde1d0ea5d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:03.955327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f9bf01da-df95-4c6f-9d83-3dde1d0ea5d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.144300 Apr 19 03:54:03.955947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 690/1330] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:03 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:04.973494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-619a8d24-c73f-4301-a2a7-71390b168f36 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:04.974164 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-619a8d24-c73f-4301-a2a7-71390b168f36 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:04.982092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-619a8d24-c73f-4301-a2a7-71390b168f36 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:04.982604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-619a8d24-c73f-4301-a2a7-71390b168f36 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:04.983493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-619a8d24-c73f-4301-a2a7-71390b168f36 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:04.984010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-619a8d24-c73f-4301-a2a7-71390b168f36 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:05.112022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-619a8d24-c73f-4301-a2a7-71390b168f36 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:05.121534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-619a8d24-c73f-4301-a2a7-71390b168f36 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.152241 Apr 19 03:54:05.122152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 641/1331] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:04 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:06.140453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9c3b2b14-60b3-4ad6-8a08-6318a66e876f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:06.141178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9c3b2b14-60b3-4ad6-8a08-6318a66e876f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:06.149222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9c3b2b14-60b3-4ad6-8a08-6318a66e876f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:06.149738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9c3b2b14-60b3-4ad6-8a08-6318a66e876f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:06.150564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9c3b2b14-60b3-4ad6-8a08-6318a66e876f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:06.151057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9c3b2b14-60b3-4ad6-8a08-6318a66e876f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:06.277385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9c3b2b14-60b3-4ad6-8a08-6318a66e876f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:06.286625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9c3b2b14-60b3-4ad6-8a08-6318a66e876f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.150757 Apr 19 03:54:06.287254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 691/1332] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:06 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:07.304617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d7abec49-5ebb-4b70-a85e-5cb5627379e2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:07.305331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d7abec49-5ebb-4b70-a85e-5cb5627379e2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:07.313157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7abec49-5ebb-4b70-a85e-5cb5627379e2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:07.313663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7abec49-5ebb-4b70-a85e-5cb5627379e2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:07.314484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7abec49-5ebb-4b70-a85e-5cb5627379e2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:07.314971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d7abec49-5ebb-4b70-a85e-5cb5627379e2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:07.436627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d7abec49-5ebb-4b70-a85e-5cb5627379e2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:07.445879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d7abec49-5ebb-4b70-a85e-5cb5627379e2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145400 Apr 19 03:54:07.446500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 642/1333] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:07 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:08.463753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-808cf0da-1e1b-4ee2-9271-74b040dae9e3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:08.464416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-808cf0da-1e1b-4ee2-9271-74b040dae9e3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:08.472789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-808cf0da-1e1b-4ee2-9271-74b040dae9e3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:08.473284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-808cf0da-1e1b-4ee2-9271-74b040dae9e3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:08.474101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-808cf0da-1e1b-4ee2-9271-74b040dae9e3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:08.474624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-808cf0da-1e1b-4ee2-9271-74b040dae9e3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:08.599817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-808cf0da-1e1b-4ee2-9271-74b040dae9e3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:08.609762 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-808cf0da-1e1b-4ee2-9271-74b040dae9e3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.149594 Apr 19 03:54:08.610373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 692/1334] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:08 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:09.629281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6778c99c-74ad-48fa-9368-e6c6718a2d34 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:09.629999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6778c99c-74ad-48fa-9368-e6c6718a2d34 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:09.637906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6778c99c-74ad-48fa-9368-e6c6718a2d34 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:09.638418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6778c99c-74ad-48fa-9368-e6c6718a2d34 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:09.639284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6778c99c-74ad-48fa-9368-e6c6718a2d34 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:09.639780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6778c99c-74ad-48fa-9368-e6c6718a2d34 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:09.762412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6778c99c-74ad-48fa-9368-e6c6718a2d34 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:09.771910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6778c99c-74ad-48fa-9368-e6c6718a2d34 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147484 Apr 19 03:54:09.772532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 643/1335] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:09 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:10.789822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6e7a7821-879d-4ee4-a77d-513190915b96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:10.790490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6e7a7821-879d-4ee4-a77d-513190915b96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:10.798273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e7a7821-879d-4ee4-a77d-513190915b96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:10.798772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e7a7821-879d-4ee4-a77d-513190915b96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:10.799620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e7a7821-879d-4ee4-a77d-513190915b96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:10.800108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6e7a7821-879d-4ee4-a77d-513190915b96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:10.920926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6e7a7821-879d-4ee4-a77d-513190915b96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:10.930094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6e7a7821-879d-4ee4-a77d-513190915b96 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.144340 Apr 19 03:54:10.930702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 693/1336] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:10 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:11.948831 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1e641f31-a36d-4c41-8632-31bbe8e51244 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:11.949510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1e641f31-a36d-4c41-8632-31bbe8e51244 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:11.958110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e641f31-a36d-4c41-8632-31bbe8e51244 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:11.958620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e641f31-a36d-4c41-8632-31bbe8e51244 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:11.959486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e641f31-a36d-4c41-8632-31bbe8e51244 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:11.959980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1e641f31-a36d-4c41-8632-31bbe8e51244 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:12.086565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1e641f31-a36d-4c41-8632-31bbe8e51244 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:12.096428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1e641f31-a36d-4c41-8632-31bbe8e51244 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.151863 Apr 19 03:54:12.097048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 644/1337] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:11 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:13.115206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fad49d16-7cca-48cb-b1f2-66adf487e34b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:13.115867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fad49d16-7cca-48cb-b1f2-66adf487e34b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:13.123982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fad49d16-7cca-48cb-b1f2-66adf487e34b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:13.124528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fad49d16-7cca-48cb-b1f2-66adf487e34b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:13.125362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fad49d16-7cca-48cb-b1f2-66adf487e34b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:13.125853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fad49d16-7cca-48cb-b1f2-66adf487e34b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:13.249378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fad49d16-7cca-48cb-b1f2-66adf487e34b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:13.258594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fad49d16-7cca-48cb-b1f2-66adf487e34b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147702 Apr 19 03:54:13.259241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 694/1338] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:13 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:14.276390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bdb37195-df46-4467-b018-ff9bd18baacc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:14.277063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bdb37195-df46-4467-b018-ff9bd18baacc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:14.284896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bdb37195-df46-4467-b018-ff9bd18baacc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:14.285402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bdb37195-df46-4467-b018-ff9bd18baacc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:14.286233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bdb37195-df46-4467-b018-ff9bd18baacc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:14.286726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bdb37195-df46-4467-b018-ff9bd18baacc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:14.410106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bdb37195-df46-4467-b018-ff9bd18baacc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:14.419345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bdb37195-df46-4467-b018-ff9bd18baacc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147012 Apr 19 03:54:14.419967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 645/1339] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:14 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:15.438949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ddadf004-84ad-4259-ba77-12e4bb1337f3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:15.439683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ddadf004-84ad-4259-ba77-12e4bb1337f3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:15.447512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ddadf004-84ad-4259-ba77-12e4bb1337f3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:15.448022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ddadf004-84ad-4259-ba77-12e4bb1337f3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:15.448845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ddadf004-84ad-4259-ba77-12e4bb1337f3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:15.449334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ddadf004-84ad-4259-ba77-12e4bb1337f3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:15.574331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ddadf004-84ad-4259-ba77-12e4bb1337f3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:15.583867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ddadf004-84ad-4259-ba77-12e4bb1337f3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.149721 Apr 19 03:54:15.584485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 695/1340] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:15 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:16.602067 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3de1ab3b-c891-4162-817d-a72b03cb0ee4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:16.602797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3de1ab3b-c891-4162-817d-a72b03cb0ee4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:16.611160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3de1ab3b-c891-4162-817d-a72b03cb0ee4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:16.611710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3de1ab3b-c891-4162-817d-a72b03cb0ee4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:16.612546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3de1ab3b-c891-4162-817d-a72b03cb0ee4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:16.613039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3de1ab3b-c891-4162-817d-a72b03cb0ee4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:16.735189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3de1ab3b-c891-4162-817d-a72b03cb0ee4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:16.744806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3de1ab3b-c891-4162-817d-a72b03cb0ee4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146865 Apr 19 03:54:16.745429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 646/1341] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:16 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:17.762832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cced4dd4-5ff4-432f-a771-7919a3cd79af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:17.763528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cced4dd4-5ff4-432f-a771-7919a3cd79af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:17.771963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cced4dd4-5ff4-432f-a771-7919a3cd79af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:17.772465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cced4dd4-5ff4-432f-a771-7919a3cd79af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:17.773285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cced4dd4-5ff4-432f-a771-7919a3cd79af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:17.773769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cced4dd4-5ff4-432f-a771-7919a3cd79af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:17.896444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cced4dd4-5ff4-432f-a771-7919a3cd79af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:17.905736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cced4dd4-5ff4-432f-a771-7919a3cd79af tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146985 Apr 19 03:54:17.906357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 696/1342] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:17 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:18.923726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6da85468-cb84-451c-bb6b-0abe73fb179b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:18.924391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6da85468-cb84-451c-bb6b-0abe73fb179b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:18.937122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6da85468-cb84-451c-bb6b-0abe73fb179b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:18.937630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6da85468-cb84-451c-bb6b-0abe73fb179b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:18.938483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6da85468-cb84-451c-bb6b-0abe73fb179b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:18.938968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6da85468-cb84-451c-bb6b-0abe73fb179b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:19.067602 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6da85468-cb84-451c-bb6b-0abe73fb179b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:19.076933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6da85468-cb84-451c-bb6b-0abe73fb179b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.157979 Apr 19 03:54:19.077583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 647/1343] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:18 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:20.095535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-48956cf1-a2e4-4ea1-beab-dcf56822c986 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:20.096210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-48956cf1-a2e4-4ea1-beab-dcf56822c986 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:20.104115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48956cf1-a2e4-4ea1-beab-dcf56822c986 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:20.104624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48956cf1-a2e4-4ea1-beab-dcf56822c986 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:20.105452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48956cf1-a2e4-4ea1-beab-dcf56822c986 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:20.105941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-48956cf1-a2e4-4ea1-beab-dcf56822c986 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:20.229158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-48956cf1-a2e4-4ea1-beab-dcf56822c986 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:20.238326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-48956cf1-a2e4-4ea1-beab-dcf56822c986 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147415 Apr 19 03:54:20.238941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 697/1344] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:20 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:21.256606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4de7121a-f51d-4773-8649-15de163d1c09 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:21.257283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4de7121a-f51d-4773-8649-15de163d1c09 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:21.265108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4de7121a-f51d-4773-8649-15de163d1c09 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:21.265617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4de7121a-f51d-4773-8649-15de163d1c09 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:21.266448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4de7121a-f51d-4773-8649-15de163d1c09 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:21.266937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4de7121a-f51d-4773-8649-15de163d1c09 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:21.389411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4de7121a-f51d-4773-8649-15de163d1c09 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:21.398729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4de7121a-f51d-4773-8649-15de163d1c09 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146240 Apr 19 03:54:21.399386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 648/1345] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:21 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:22.417212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d5e843ad-61cb-4554-9cc2-98cea1903d3d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:22.417876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d5e843ad-61cb-4554-9cc2-98cea1903d3d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:22.426162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5e843ad-61cb-4554-9cc2-98cea1903d3d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:22.426669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5e843ad-61cb-4554-9cc2-98cea1903d3d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:22.427509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5e843ad-61cb-4554-9cc2-98cea1903d3d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:22.427993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5e843ad-61cb-4554-9cc2-98cea1903d3d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:22.554266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d5e843ad-61cb-4554-9cc2-98cea1903d3d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:22.564513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d5e843ad-61cb-4554-9cc2-98cea1903d3d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.151417 Apr 19 03:54:22.565130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 698/1346] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:22 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:23.583885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f149ce1f-f372-448e-92ce-02f6047e5f17 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:23.584493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f149ce1f-f372-448e-92ce-02f6047e5f17 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:23.592430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f149ce1f-f372-448e-92ce-02f6047e5f17 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:23.592915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f149ce1f-f372-448e-92ce-02f6047e5f17 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:23.593743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f149ce1f-f372-448e-92ce-02f6047e5f17 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:23.594230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f149ce1f-f372-448e-92ce-02f6047e5f17 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:23.715905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f149ce1f-f372-448e-92ce-02f6047e5f17 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:23.725369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f149ce1f-f372-448e-92ce-02f6047e5f17 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145829 Apr 19 03:54:23.725987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 649/1347] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:23 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:24.742572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1eedc9bc-13e1-4d00-8dd6-37a8d1d088bf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:24.743530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1eedc9bc-13e1-4d00-8dd6-37a8d1d088bf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:24.751993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1eedc9bc-13e1-4d00-8dd6-37a8d1d088bf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:24.752499 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1eedc9bc-13e1-4d00-8dd6-37a8d1d088bf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:24.753325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1eedc9bc-13e1-4d00-8dd6-37a8d1d088bf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:24.753816 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1eedc9bc-13e1-4d00-8dd6-37a8d1d088bf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:24.874442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1eedc9bc-13e1-4d00-8dd6-37a8d1d088bf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:24.883672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1eedc9bc-13e1-4d00-8dd6-37a8d1d088bf tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145217 Apr 19 03:54:24.884290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 699/1348] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:24 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:25.901780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a45ac978-aaba-4fce-ac49-098c2eb4e8e4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:25.902398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a45ac978-aaba-4fce-ac49-098c2eb4e8e4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:25.910334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a45ac978-aaba-4fce-ac49-098c2eb4e8e4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:25.910841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a45ac978-aaba-4fce-ac49-098c2eb4e8e4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:25.911696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a45ac978-aaba-4fce-ac49-098c2eb4e8e4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:25.912184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a45ac978-aaba-4fce-ac49-098c2eb4e8e4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:26.038455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a45ac978-aaba-4fce-ac49-098c2eb4e8e4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:26.048248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a45ac978-aaba-4fce-ac49-098c2eb4e8e4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.150637 Apr 19 03:54:26.048867 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 650/1349] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:25 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:27.066237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-19078336-ecdb-4ce1-9fdd-33abb0356654 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:27.066909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-19078336-ecdb-4ce1-9fdd-33abb0356654 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:27.074711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19078336-ecdb-4ce1-9fdd-33abb0356654 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:27.075269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19078336-ecdb-4ce1-9fdd-33abb0356654 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:27.076106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19078336-ecdb-4ce1-9fdd-33abb0356654 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:27.076608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19078336-ecdb-4ce1-9fdd-33abb0356654 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:27.200090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-19078336-ecdb-4ce1-9fdd-33abb0356654 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:27.209950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-19078336-ecdb-4ce1-9fdd-33abb0356654 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147838 Apr 19 03:54:27.210566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 700/1350] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:27 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:28.227887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ea73ee7c-4e60-44a6-ae6f-84838fd1c62d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:28.228553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ea73ee7c-4e60-44a6-ae6f-84838fd1c62d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:28.236948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea73ee7c-4e60-44a6-ae6f-84838fd1c62d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:28.237446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea73ee7c-4e60-44a6-ae6f-84838fd1c62d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:28.238266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea73ee7c-4e60-44a6-ae6f-84838fd1c62d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:28.238750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea73ee7c-4e60-44a6-ae6f-84838fd1c62d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:28.363659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea73ee7c-4e60-44a6-ae6f-84838fd1c62d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:28.373708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ea73ee7c-4e60-44a6-ae6f-84838fd1c62d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.149723 Apr 19 03:54:28.384038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 651/1351] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:28 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:29.391892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-050b7506-c6e1-4a4b-8dd2-fc8fdb692dac tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:29.392565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-050b7506-c6e1-4a4b-8dd2-fc8fdb692dac tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:29.400354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-050b7506-c6e1-4a4b-8dd2-fc8fdb692dac tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:29.400860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-050b7506-c6e1-4a4b-8dd2-fc8fdb692dac tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:29.401690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-050b7506-c6e1-4a4b-8dd2-fc8fdb692dac tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:29.402180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-050b7506-c6e1-4a4b-8dd2-fc8fdb692dac tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:29.525997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-050b7506-c6e1-4a4b-8dd2-fc8fdb692dac tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:29.535834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-050b7506-c6e1-4a4b-8dd2-fc8fdb692dac tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.148031 Apr 19 03:54:29.536456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 701/1352] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:29 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:30.554756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-917d4586-79d0-4b42-b2a7-83675f643d58 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:30.555461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-917d4586-79d0-4b42-b2a7-83675f643d58 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:30.564030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-917d4586-79d0-4b42-b2a7-83675f643d58 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:30.564541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-917d4586-79d0-4b42-b2a7-83675f643d58 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:30.565369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-917d4586-79d0-4b42-b2a7-83675f643d58 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:30.565860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-917d4586-79d0-4b42-b2a7-83675f643d58 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:30.687225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-917d4586-79d0-4b42-b2a7-83675f643d58 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:30.696532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-917d4586-79d0-4b42-b2a7-83675f643d58 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145905 Apr 19 03:54:30.697151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 652/1353] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:30 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:31.715492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0430c764-3eb7-4bb4-ae4d-fa0254ce6c77 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:31.721382 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0430c764-3eb7-4bb4-ae4d-fa0254ce6c77 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:31.724033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0430c764-3eb7-4bb4-ae4d-fa0254ce6c77 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:31.724539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0430c764-3eb7-4bb4-ae4d-fa0254ce6c77 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:31.725358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0430c764-3eb7-4bb4-ae4d-fa0254ce6c77 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:31.725847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0430c764-3eb7-4bb4-ae4d-fa0254ce6c77 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:31.913962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0430c764-3eb7-4bb4-ae4d-fa0254ce6c77 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:31.923297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0430c764-3eb7-4bb4-ae4d-fa0254ce6c77 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.212404 Apr 19 03:54:31.923919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 702/1354] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:31 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:32.941439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d839d6ea-1e7f-4c2a-b860-de64f334575e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:32.942116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d839d6ea-1e7f-4c2a-b860-de64f334575e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:32.949931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d839d6ea-1e7f-4c2a-b860-de64f334575e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:32.950437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d839d6ea-1e7f-4c2a-b860-de64f334575e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:32.951309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d839d6ea-1e7f-4c2a-b860-de64f334575e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:32.952345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d839d6ea-1e7f-4c2a-b860-de64f334575e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:33.080419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d839d6ea-1e7f-4c2a-b860-de64f334575e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:33.089613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d839d6ea-1e7f-4c2a-b860-de64f334575e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.152364 Apr 19 03:54:33.090231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 653/1355] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:32 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:34.109031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dfc49244-6942-4c17-9660-0408333713a3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:34.109698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dfc49244-6942-4c17-9660-0408333713a3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:34.117662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfc49244-6942-4c17-9660-0408333713a3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:34.118421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfc49244-6942-4c17-9660-0408333713a3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:34.119294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfc49244-6942-4c17-9660-0408333713a3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:34.119788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dfc49244-6942-4c17-9660-0408333713a3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:34.251175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dfc49244-6942-4c17-9660-0408333713a3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:34.261133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dfc49244-6942-4c17-9660-0408333713a3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.156820 Apr 19 03:54:34.261755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 703/1356] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:34 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:35.278798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-845e5a55-8380-4231-8640-9917616b1b6e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:35.279705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-845e5a55-8380-4231-8640-9917616b1b6e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:35.287548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-845e5a55-8380-4231-8640-9917616b1b6e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:35.288059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-845e5a55-8380-4231-8640-9917616b1b6e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:35.288892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-845e5a55-8380-4231-8640-9917616b1b6e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:35.289385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-845e5a55-8380-4231-8640-9917616b1b6e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:35.413599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-845e5a55-8380-4231-8640-9917616b1b6e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:35.423637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-845e5a55-8380-4231-8640-9917616b1b6e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.148967 Apr 19 03:54:35.424264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 654/1357] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:35 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:36.442302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d3cf91ab-c3dc-4450-aa1b-8a31a2cbc0b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:36.442977 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d3cf91ab-c3dc-4450-aa1b-8a31a2cbc0b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:36.450780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3cf91ab-c3dc-4450-aa1b-8a31a2cbc0b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:36.451318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3cf91ab-c3dc-4450-aa1b-8a31a2cbc0b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:36.452738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3cf91ab-c3dc-4450-aa1b-8a31a2cbc0b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:36.453230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d3cf91ab-c3dc-4450-aa1b-8a31a2cbc0b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:36.801472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d3cf91ab-c3dc-4450-aa1b-8a31a2cbc0b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:36.811579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d3cf91ab-c3dc-4450-aa1b-8a31a2cbc0b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.372802 Apr 19 03:54:36.812199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 704/1358] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:36 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:37.830757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6ceb464d-eea7-4fb9-8575-84a44d26588d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:37.831466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6ceb464d-eea7-4fb9-8575-84a44d26588d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:37.839357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ceb464d-eea7-4fb9-8575-84a44d26588d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:37.839902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ceb464d-eea7-4fb9-8575-84a44d26588d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:37.840731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ceb464d-eea7-4fb9-8575-84a44d26588d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:37.841221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6ceb464d-eea7-4fb9-8575-84a44d26588d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:37.962608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6ceb464d-eea7-4fb9-8575-84a44d26588d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:37.972074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6ceb464d-eea7-4fb9-8575-84a44d26588d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146194 Apr 19 03:54:37.972703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 655/1359] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:37 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:38.990132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-646d3772-77e2-429f-9264-133b4a472c9e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:38.990804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-646d3772-77e2-429f-9264-133b4a472c9e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:38.998952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-646d3772-77e2-429f-9264-133b4a472c9e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:38.999487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-646d3772-77e2-429f-9264-133b4a472c9e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:39.000317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-646d3772-77e2-429f-9264-133b4a472c9e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:39.000811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-646d3772-77e2-429f-9264-133b4a472c9e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:39.121374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-646d3772-77e2-429f-9264-133b4a472c9e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:39.130588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-646d3772-77e2-429f-9264-133b4a472c9e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.144537 Apr 19 03:54:39.131226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 705/1360] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:38 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:40.149238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8bb40953-59c8-43b1-8e60-acebdb65ed47 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:40.149950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8bb40953-59c8-43b1-8e60-acebdb65ed47 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:40.158270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bb40953-59c8-43b1-8e60-acebdb65ed47 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:40.158774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bb40953-59c8-43b1-8e60-acebdb65ed47 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:40.159625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bb40953-59c8-43b1-8e60-acebdb65ed47 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:40.160113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8bb40953-59c8-43b1-8e60-acebdb65ed47 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:40.286225 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8bb40953-59c8-43b1-8e60-acebdb65ed47 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:40.295628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8bb40953-59c8-43b1-8e60-acebdb65ed47 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.150559 Apr 19 03:54:40.296243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 656/1361] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:40 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:41.314267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-79207936-acc0-408a-bc7e-4b1665bb0490 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:41.314911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-79207936-acc0-408a-bc7e-4b1665bb0490 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:41.322765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79207936-acc0-408a-bc7e-4b1665bb0490 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:41.323305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79207936-acc0-408a-bc7e-4b1665bb0490 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:41.324128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79207936-acc0-408a-bc7e-4b1665bb0490 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:41.324616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-79207936-acc0-408a-bc7e-4b1665bb0490 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:41.451384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-79207936-acc0-408a-bc7e-4b1665bb0490 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:41.460542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-79207936-acc0-408a-bc7e-4b1665bb0490 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.151000 Apr 19 03:54:41.461155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 706/1362] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:41 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:42.479151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7c31f775-c8c4-46ed-a3cc-704277139226 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:42.479853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7c31f775-c8c4-46ed-a3cc-704277139226 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:42.487800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c31f775-c8c4-46ed-a3cc-704277139226 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:42.488301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c31f775-c8c4-46ed-a3cc-704277139226 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:42.489117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c31f775-c8c4-46ed-a3cc-704277139226 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:42.489600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c31f775-c8c4-46ed-a3cc-704277139226 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:42.612097 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7c31f775-c8c4-46ed-a3cc-704277139226 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:42.622041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7c31f775-c8c4-46ed-a3cc-704277139226 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147088 Apr 19 03:54:42.622695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 657/1363] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:42 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:43.641236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-08f3ffb3-d917-42c0-b5bf-19f8085c33e8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:43.641972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-08f3ffb3-d917-42c0-b5bf-19f8085c33e8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:43.649814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08f3ffb3-d917-42c0-b5bf-19f8085c33e8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:43.650324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08f3ffb3-d917-42c0-b5bf-19f8085c33e8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:43.651190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08f3ffb3-d917-42c0-b5bf-19f8085c33e8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:43.651676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08f3ffb3-d917-42c0-b5bf-19f8085c33e8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:43.773808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-08f3ffb3-d917-42c0-b5bf-19f8085c33e8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:43.783242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-08f3ffb3-d917-42c0-b5bf-19f8085c33e8 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146706 Apr 19 03:54:43.783864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 707/1364] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:43 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:44.802099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b2af93c6-9ba2-4000-bd38-4267389197cd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:44.802772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b2af93c6-9ba2-4000-bd38-4267389197cd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:44.810657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2af93c6-9ba2-4000-bd38-4267389197cd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:44.811178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2af93c6-9ba2-4000-bd38-4267389197cd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:44.812037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2af93c6-9ba2-4000-bd38-4267389197cd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:44.812524 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2af93c6-9ba2-4000-bd38-4267389197cd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:44.935029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b2af93c6-9ba2-4000-bd38-4267389197cd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:44.944342 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b2af93c6-9ba2-4000-bd38-4267389197cd tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146378 Apr 19 03:54:44.944962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 658/1365] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:44 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:45.962963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-df1c2f4e-3b6f-469a-b61f-3cf71e86a939 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:45.963667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-df1c2f4e-3b6f-469a-b61f-3cf71e86a939 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:45.971982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df1c2f4e-3b6f-469a-b61f-3cf71e86a939 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:45.972488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df1c2f4e-3b6f-469a-b61f-3cf71e86a939 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:45.973321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df1c2f4e-3b6f-469a-b61f-3cf71e86a939 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:45.973810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-df1c2f4e-3b6f-469a-b61f-3cf71e86a939 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:46.094357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-df1c2f4e-3b6f-469a-b61f-3cf71e86a939 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:46.103655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-df1c2f4e-3b6f-469a-b61f-3cf71e86a939 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.144856 Apr 19 03:54:46.104277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 708/1366] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:45 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:47.121628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-22416354-9c56-4cd0-83bf-1352588c9da4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:47.122709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-22416354-9c56-4cd0-83bf-1352588c9da4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:47.131214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22416354-9c56-4cd0-83bf-1352588c9da4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:47.131719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22416354-9c56-4cd0-83bf-1352588c9da4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:47.132540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22416354-9c56-4cd0-83bf-1352588c9da4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:47.133027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22416354-9c56-4cd0-83bf-1352588c9da4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:47.259228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-22416354-9c56-4cd0-83bf-1352588c9da4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:47.268624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-22416354-9c56-4cd0-83bf-1352588c9da4 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.151360 Apr 19 03:54:47.269239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 659/1367] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:47 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:48.286641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3cde5cc9-e7c9-4260-9139-d081e2b940f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:48.287404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3cde5cc9-e7c9-4260-9139-d081e2b940f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:48.295262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3cde5cc9-e7c9-4260-9139-d081e2b940f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:48.295770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3cde5cc9-e7c9-4260-9139-d081e2b940f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:48.296593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3cde5cc9-e7c9-4260-9139-d081e2b940f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:48.297090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3cde5cc9-e7c9-4260-9139-d081e2b940f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:48.425799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3cde5cc9-e7c9-4260-9139-d081e2b940f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:48.435049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3cde5cc9-e7c9-4260-9139-d081e2b940f1 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.152500 Apr 19 03:54:48.436201 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 709/1368] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:48 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:49.454218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fd61a9c7-1733-4b0d-b9fd-b690d589d3b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:49.454893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fd61a9c7-1733-4b0d-b9fd-b690d589d3b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:49.462682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd61a9c7-1733-4b0d-b9fd-b690d589d3b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:49.463206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd61a9c7-1733-4b0d-b9fd-b690d589d3b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:49.464042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd61a9c7-1733-4b0d-b9fd-b690d589d3b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:49.464527 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd61a9c7-1733-4b0d-b9fd-b690d589d3b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:49.586303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fd61a9c7-1733-4b0d-b9fd-b690d589d3b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:49.596536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fd61a9c7-1733-4b0d-b9fd-b690d589d3b3 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146821 Apr 19 03:54:49.597158 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 660/1369] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:49 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:50.615092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e8080ba7-9072-42f7-8c33-b15b4834e4fa tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:50.616048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e8080ba7-9072-42f7-8c33-b15b4834e4fa tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:50.626812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8080ba7-9072-42f7-8c33-b15b4834e4fa tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:50.627348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8080ba7-9072-42f7-8c33-b15b4834e4fa tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:50.628232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8080ba7-9072-42f7-8c33-b15b4834e4fa tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:50.628866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8080ba7-9072-42f7-8c33-b15b4834e4fa tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:50.756213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e8080ba7-9072-42f7-8c33-b15b4834e4fa tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:50.765503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e8080ba7-9072-42f7-8c33-b15b4834e4fa tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.154762 Apr 19 03:54:50.766124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 710/1370] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:50 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:51.784087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-febd1e0b-0ed2-46f2-a917-4fd8ccd8f415 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:51.784752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-febd1e0b-0ed2-46f2-a917-4fd8ccd8f415 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:51.792528 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-febd1e0b-0ed2-46f2-a917-4fd8ccd8f415 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:51.793029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-febd1e0b-0ed2-46f2-a917-4fd8ccd8f415 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:51.793848 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-febd1e0b-0ed2-46f2-a917-4fd8ccd8f415 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:51.794332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-febd1e0b-0ed2-46f2-a917-4fd8ccd8f415 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:51.916339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-febd1e0b-0ed2-46f2-a917-4fd8ccd8f415 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:51.926322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-febd1e0b-0ed2-46f2-a917-4fd8ccd8f415 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146313 Apr 19 03:54:51.926931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 661/1371] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:51 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:52.944406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-93948ed0-0a2d-4b56-97ba-b5e5abbb213a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:52.945078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-93948ed0-0a2d-4b56-97ba-b5e5abbb213a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:52.953662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93948ed0-0a2d-4b56-97ba-b5e5abbb213a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:52.954167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93948ed0-0a2d-4b56-97ba-b5e5abbb213a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:52.954999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93948ed0-0a2d-4b56-97ba-b5e5abbb213a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:52.955518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93948ed0-0a2d-4b56-97ba-b5e5abbb213a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:53.091817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-93948ed0-0a2d-4b56-97ba-b5e5abbb213a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:53.101162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-93948ed0-0a2d-4b56-97ba-b5e5abbb213a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.160925 Apr 19 03:54:53.101784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 711/1372] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:52 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:54.120247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-22712408-b647-4c0f-bd7b-a9c996126b68 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:54.120921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-22712408-b647-4c0f-bd7b-a9c996126b68 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:54.128751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22712408-b647-4c0f-bd7b-a9c996126b68 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:54.129259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22712408-b647-4c0f-bd7b-a9c996126b68 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:54.130085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22712408-b647-4c0f-bd7b-a9c996126b68 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:54.130579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22712408-b647-4c0f-bd7b-a9c996126b68 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:54.258057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-22712408-b647-4c0f-bd7b-a9c996126b68 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:54.268038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-22712408-b647-4c0f-bd7b-a9c996126b68 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.152162 Apr 19 03:54:54.268654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 662/1373] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:54 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:55.286035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3d21e88d-47c3-449a-ae60-0f5f90a4d3d5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:55.286719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3d21e88d-47c3-449a-ae60-0f5f90a4d3d5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:55.294588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d21e88d-47c3-449a-ae60-0f5f90a4d3d5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:55.295647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d21e88d-47c3-449a-ae60-0f5f90a4d3d5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:55.296483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d21e88d-47c3-449a-ae60-0f5f90a4d3d5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:55.296982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3d21e88d-47c3-449a-ae60-0f5f90a4d3d5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:55.424040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3d21e88d-47c3-449a-ae60-0f5f90a4d3d5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:55.433588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3d21e88d-47c3-449a-ae60-0f5f90a4d3d5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.151639 Apr 19 03:54:55.434206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 712/1374] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:55 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:56.452234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-986b230a-0542-4e88-8143-cbadc3d3a67b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:56.452904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-986b230a-0542-4e88-8143-cbadc3d3a67b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:56.460755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-986b230a-0542-4e88-8143-cbadc3d3a67b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:56.461262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-986b230a-0542-4e88-8143-cbadc3d3a67b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:56.462091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-986b230a-0542-4e88-8143-cbadc3d3a67b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:56.462582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-986b230a-0542-4e88-8143-cbadc3d3a67b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:56.584894 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-986b230a-0542-4e88-8143-cbadc3d3a67b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:56.594509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-986b230a-0542-4e88-8143-cbadc3d3a67b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147023 Apr 19 03:54:56.595135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 663/1375] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:56 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:57.612723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-826bcba1-d1c6-40c6-b505-234ff77ad72e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:57.622734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-826bcba1-d1c6-40c6-b505-234ff77ad72e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:57.622734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-826bcba1-d1c6-40c6-b505-234ff77ad72e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:57.622734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-826bcba1-d1c6-40c6-b505-234ff77ad72e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:57.622734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-826bcba1-d1c6-40c6-b505-234ff77ad72e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:57.623409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-826bcba1-d1c6-40c6-b505-234ff77ad72e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:57.745699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-826bcba1-d1c6-40c6-b505-234ff77ad72e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:57.755118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-826bcba1-d1c6-40c6-b505-234ff77ad72e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146565 Apr 19 03:54:57.755762 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 713/1376] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:57 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:58.774215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0e45aea7-1dc2-4334-ae6c-87bdd2cccea6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:58.774887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0e45aea7-1dc2-4334-ae6c-87bdd2cccea6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:58.783195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e45aea7-1dc2-4334-ae6c-87bdd2cccea6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:58.783712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e45aea7-1dc2-4334-ae6c-87bdd2cccea6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:58.784645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e45aea7-1dc2-4334-ae6c-87bdd2cccea6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:58.785133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0e45aea7-1dc2-4334-ae6c-87bdd2cccea6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:58.905808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0e45aea7-1dc2-4334-ae6c-87bdd2cccea6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:54:58.914927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0e45aea7-1dc2-4334-ae6c-87bdd2cccea6 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145362 Apr 19 03:54:58.915594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 664/1377] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:58 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:54:59.933634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1d946dea-3df4-4f8a-bdea-c93f7a04ad22 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:54:59.934311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1d946dea-3df4-4f8a-bdea-c93f7a04ad22 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:54:59.943019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d946dea-3df4-4f8a-bdea-c93f7a04ad22 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:59.943570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d946dea-3df4-4f8a-bdea-c93f7a04ad22 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:54:59.944402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d946dea-3df4-4f8a-bdea-c93f7a04ad22 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:54:59.944891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d946dea-3df4-4f8a-bdea-c93f7a04ad22 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:00.065529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1d946dea-3df4-4f8a-bdea-c93f7a04ad22 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:00.074828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1d946dea-3df4-4f8a-bdea-c93f7a04ad22 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145288 Apr 19 03:55:00.075478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 714/1378] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:54:59 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:01.093232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-06b26f7f-500a-4759-bc4f-d70ad3ef1ab5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:01.093907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-06b26f7f-500a-4759-bc4f-d70ad3ef1ab5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:01.097304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] AMQP server on 10.222.0.25:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 19 03:55:01.102656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06b26f7f-500a-4759-bc4f-d70ad3ef1ab5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:01.103170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06b26f7f-500a-4759-bc4f-d70ad3ef1ab5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:01.104014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06b26f7f-500a-4759-bc4f-d70ad3ef1ab5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:01.104502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06b26f7f-500a-4759-bc4f-d70ad3ef1ab5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:01.230764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-06b26f7f-500a-4759-bc4f-d70ad3ef1ab5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:01.240463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-06b26f7f-500a-4759-bc4f-d70ad3ef1ab5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.151540 Apr 19 03:55:01.241086 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 665/1379] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:01 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:02.259308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6c18a164-bc7f-4ccc-97dd-b2e824f90a10 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:02.259985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6c18a164-bc7f-4ccc-97dd-b2e824f90a10 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:02.268350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c18a164-bc7f-4ccc-97dd-b2e824f90a10 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:02.268857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c18a164-bc7f-4ccc-97dd-b2e824f90a10 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:02.269682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c18a164-bc7f-4ccc-97dd-b2e824f90a10 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:02.270170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c18a164-bc7f-4ccc-97dd-b2e824f90a10 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:02.397923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6c18a164-bc7f-4ccc-97dd-b2e824f90a10 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:02.408044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6c18a164-bc7f-4ccc-97dd-b2e824f90a10 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.152909 Apr 19 03:55:02.408665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 715/1380] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:02 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:03.426788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2bf3dd4e-8ba1-4bae-9fca-6ce9f0023cca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:03.427486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2bf3dd4e-8ba1-4bae-9fca-6ce9f0023cca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:03.446253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2bf3dd4e-8ba1-4bae-9fca-6ce9f0023cca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:03.446761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2bf3dd4e-8ba1-4bae-9fca-6ce9f0023cca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:03.447624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2bf3dd4e-8ba1-4bae-9fca-6ce9f0023cca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:03.448119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2bf3dd4e-8ba1-4bae-9fca-6ce9f0023cca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:03.484233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41492. Apr 19 03:55:03.570523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2bf3dd4e-8ba1-4bae-9fca-6ce9f0023cca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:03.580665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2bf3dd4e-8ba1-4bae-9fca-6ce9f0023cca tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.158071 Apr 19 03:55:03.581285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 666/1381] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:03 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:04.598427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-36f39b22-b02b-4dc8-b76f-ac2ab89aa3cc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:04.599127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-36f39b22-b02b-4dc8-b76f-ac2ab89aa3cc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:04.607003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36f39b22-b02b-4dc8-b76f-ac2ab89aa3cc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:04.608039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36f39b22-b02b-4dc8-b76f-ac2ab89aa3cc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:04.608912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36f39b22-b02b-4dc8-b76f-ac2ab89aa3cc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:04.609405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36f39b22-b02b-4dc8-b76f-ac2ab89aa3cc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:04.730551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-36f39b22-b02b-4dc8-b76f-ac2ab89aa3cc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:04.740953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-36f39b22-b02b-4dc8-b76f-ac2ab89aa3cc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146672 Apr 19 03:55:04.741580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 716/1382] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:04 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:05.759975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8e23ab13-fd02-4f8a-869d-ae52be7bc14a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:05.760688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8e23ab13-fd02-4f8a-869d-ae52be7bc14a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:05.769105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e23ab13-fd02-4f8a-869d-ae52be7bc14a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:05.769663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e23ab13-fd02-4f8a-869d-ae52be7bc14a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:05.770495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e23ab13-fd02-4f8a-869d-ae52be7bc14a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:05.770991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e23ab13-fd02-4f8a-869d-ae52be7bc14a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:05.892337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8e23ab13-fd02-4f8a-869d-ae52be7bc14a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:05.901666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8e23ab13-fd02-4f8a-869d-ae52be7bc14a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145822 Apr 19 03:55:05.902281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 667/1383] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:05 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:06.919966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a87d136f-6c3e-4960-8cc5-c3ba40ded80e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:06.920587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a87d136f-6c3e-4960-8cc5-c3ba40ded80e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:06.928435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a87d136f-6c3e-4960-8cc5-c3ba40ded80e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:06.928942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a87d136f-6c3e-4960-8cc5-c3ba40ded80e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:06.929764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a87d136f-6c3e-4960-8cc5-c3ba40ded80e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:06.930249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a87d136f-6c3e-4960-8cc5-c3ba40ded80e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:07.051111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a87d136f-6c3e-4960-8cc5-c3ba40ded80e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:07.062186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a87d136f-6c3e-4960-8cc5-c3ba40ded80e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146597 Apr 19 03:55:07.062808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 717/1384] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:06 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:08.079395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-51c2c81c-73fc-43e7-a4ce-83bd9aedceda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:08.080075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-51c2c81c-73fc-43e7-a4ce-83bd9aedceda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:08.088021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-51c2c81c-73fc-43e7-a4ce-83bd9aedceda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:08.088540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-51c2c81c-73fc-43e7-a4ce-83bd9aedceda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:08.089381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-51c2c81c-73fc-43e7-a4ce-83bd9aedceda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:08.089877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-51c2c81c-73fc-43e7-a4ce-83bd9aedceda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:08.216854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-51c2c81c-73fc-43e7-a4ce-83bd9aedceda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:08.226077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-51c2c81c-73fc-43e7-a4ce-83bd9aedceda tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.150873 Apr 19 03:55:08.226698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 668/1385] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:08 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:09.245268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-98299bb5-4370-46c9-b02d-3d4d902ed48f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:09.245941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-98299bb5-4370-46c9-b02d-3d4d902ed48f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:09.254300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98299bb5-4370-46c9-b02d-3d4d902ed48f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:09.254806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98299bb5-4370-46c9-b02d-3d4d902ed48f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:09.255651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98299bb5-4370-46c9-b02d-3d4d902ed48f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:09.256143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98299bb5-4370-46c9-b02d-3d4d902ed48f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:09.382850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-98299bb5-4370-46c9-b02d-3d4d902ed48f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:09.392719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-98299bb5-4370-46c9-b02d-3d4d902ed48f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.151900 Apr 19 03:55:09.393559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 718/1386] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:09 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:10.411339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5f03e659-8d6c-4269-8802-b084760b425f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:10.412014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5f03e659-8d6c-4269-8802-b084760b425f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:10.419797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f03e659-8d6c-4269-8802-b084760b425f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:10.420307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f03e659-8d6c-4269-8802-b084760b425f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:10.421139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f03e659-8d6c-4269-8802-b084760b425f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:10.421629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f03e659-8d6c-4269-8802-b084760b425f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:10.542861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5f03e659-8d6c-4269-8802-b084760b425f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:10.552771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5f03e659-8d6c-4269-8802-b084760b425f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145561 Apr 19 03:55:10.553393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 669/1387] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:10 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:11.570713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-70f0534e-d6cd-4f7c-99fc-92b9c6b2c666 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:11.571406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-70f0534e-d6cd-4f7c-99fc-92b9c6b2c666 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:11.579282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70f0534e-d6cd-4f7c-99fc-92b9c6b2c666 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:11.579789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70f0534e-d6cd-4f7c-99fc-92b9c6b2c666 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:11.580614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70f0534e-d6cd-4f7c-99fc-92b9c6b2c666 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:11.581094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-70f0534e-d6cd-4f7c-99fc-92b9c6b2c666 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:11.702758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-70f0534e-d6cd-4f7c-99fc-92b9c6b2c666 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:11.711953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-70f0534e-d6cd-4f7c-99fc-92b9c6b2c666 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145333 Apr 19 03:55:11.712571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 719/1388] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:11 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:12.730572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c0c7b2e4-b83e-4269-a781-fbda4e60a96b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:12.731268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c0c7b2e4-b83e-4269-a781-fbda4e60a96b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:12.739553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0c7b2e4-b83e-4269-a781-fbda4e60a96b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:12.740051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0c7b2e4-b83e-4269-a781-fbda4e60a96b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:12.740876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0c7b2e4-b83e-4269-a781-fbda4e60a96b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:12.741409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0c7b2e4-b83e-4269-a781-fbda4e60a96b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:12.862507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c0c7b2e4-b83e-4269-a781-fbda4e60a96b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:12.872007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c0c7b2e4-b83e-4269-a781-fbda4e60a96b tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145666 Apr 19 03:55:12.873220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 670/1389] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:12 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:13.891493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-01f767d8-8b79-40c7-befc-f51c7cb57454 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:13.892095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-01f767d8-8b79-40c7-befc-f51c7cb57454 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:13.900033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01f767d8-8b79-40c7-befc-f51c7cb57454 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:13.900541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01f767d8-8b79-40c7-befc-f51c7cb57454 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:13.901373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01f767d8-8b79-40c7-befc-f51c7cb57454 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:13.901864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01f767d8-8b79-40c7-befc-f51c7cb57454 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:14.023100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-01f767d8-8b79-40c7-befc-f51c7cb57454 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:14.032354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-01f767d8-8b79-40c7-befc-f51c7cb57454 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145770 Apr 19 03:55:14.032974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 720/1390] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:13 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:15.050522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ab50fd49-f756-4b75-a452-e161e9604ced tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:15.051220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ab50fd49-f756-4b75-a452-e161e9604ced tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:15.059074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab50fd49-f756-4b75-a452-e161e9604ced tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:15.059613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab50fd49-f756-4b75-a452-e161e9604ced tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:15.060445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab50fd49-f756-4b75-a452-e161e9604ced tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:15.060936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ab50fd49-f756-4b75-a452-e161e9604ced tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:15.188386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ab50fd49-f756-4b75-a452-e161e9604ced tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:15.197591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ab50fd49-f756-4b75-a452-e161e9604ced tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.151157 Apr 19 03:55:15.198207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 671/1391] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:15 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:16.217261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c91689ee-b97d-4636-be4e-019122fc2a65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:16.217922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c91689ee-b97d-4636-be4e-019122fc2a65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:16.221260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] AMQP server on 10.222.0.25:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 19 03:55:16.226530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c91689ee-b97d-4636-be4e-019122fc2a65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:16.227037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c91689ee-b97d-4636-be4e-019122fc2a65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:16.227925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c91689ee-b97d-4636-be4e-019122fc2a65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:16.228413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c91689ee-b97d-4636-be4e-019122fc2a65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:16.358704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c91689ee-b97d-4636-be4e-019122fc2a65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:16.367998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c91689ee-b97d-4636-be4e-019122fc2a65 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.155474 Apr 19 03:55:16.368872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 721/1392] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:16 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:17.386237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e5f73700-604d-43c1-9a65-a8fe67f0f3d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:17.386903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e5f73700-604d-43c1-9a65-a8fe67f0f3d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:17.394666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5f73700-604d-43c1-9a65-a8fe67f0f3d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:17.395221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5f73700-604d-43c1-9a65-a8fe67f0f3d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:17.396049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5f73700-604d-43c1-9a65-a8fe67f0f3d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:17.396536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e5f73700-604d-43c1-9a65-a8fe67f0f3d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:17.517699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e5f73700-604d-43c1-9a65-a8fe67f0f3d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:17.526883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e5f73700-604d-43c1-9a65-a8fe67f0f3d7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.144744 Apr 19 03:55:17.527550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 672/1393] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:17 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:18.546065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e6f7a24a-140a-458d-a5bd-2c96fba0f8c5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:18.546733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e6f7a24a-140a-458d-a5bd-2c96fba0f8c5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:18.566323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e6f7a24a-140a-458d-a5bd-2c96fba0f8c5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:18.566824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e6f7a24a-140a-458d-a5bd-2c96fba0f8c5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:18.567686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e6f7a24a-140a-458d-a5bd-2c96fba0f8c5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:18.568174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e6f7a24a-140a-458d-a5bd-2c96fba0f8c5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:18.603472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41520. Apr 19 03:55:18.692113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e6f7a24a-140a-458d-a5bd-2c96fba0f8c5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:18.701365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e6f7a24a-140a-458d-a5bd-2c96fba0f8c5 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.159966 Apr 19 03:55:18.701982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 722/1394] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:18 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:19.719879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5ab9625b-7b81-425a-b019-b39bfc2d0c66 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:19.720550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5ab9625b-7b81-425a-b019-b39bfc2d0c66 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:19.728494 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ab9625b-7b81-425a-b019-b39bfc2d0c66 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:19.729002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ab9625b-7b81-425a-b019-b39bfc2d0c66 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:19.729830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ab9625b-7b81-425a-b019-b39bfc2d0c66 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:19.730322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ab9625b-7b81-425a-b019-b39bfc2d0c66 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:19.851712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5ab9625b-7b81-425a-b019-b39bfc2d0c66 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:19.861054 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5ab9625b-7b81-425a-b019-b39bfc2d0c66 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145298 Apr 19 03:55:19.861672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 673/1395] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:19 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:20.879461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e22a9074-1385-42ac-91a4-bb53ea430f73 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:20.880075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e22a9074-1385-42ac-91a4-bb53ea430f73 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:20.887903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e22a9074-1385-42ac-91a4-bb53ea430f73 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:20.888404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e22a9074-1385-42ac-91a4-bb53ea430f73 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:20.889708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e22a9074-1385-42ac-91a4-bb53ea430f73 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:20.890196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e22a9074-1385-42ac-91a4-bb53ea430f73 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:21.010574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e22a9074-1385-42ac-91a4-bb53ea430f73 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:21.020336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e22a9074-1385-42ac-91a4-bb53ea430f73 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145123 Apr 19 03:55:21.020964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 723/1396] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:20 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:22.038907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c04a8234-e596-437f-b6e1-32dddc54f51f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:22.039624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c04a8234-e596-437f-b6e1-32dddc54f51f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:22.048357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c04a8234-e596-437f-b6e1-32dddc54f51f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:22.048872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c04a8234-e596-437f-b6e1-32dddc54f51f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:22.049707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c04a8234-e596-437f-b6e1-32dddc54f51f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:22.050204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c04a8234-e596-437f-b6e1-32dddc54f51f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:22.177824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c04a8234-e596-437f-b6e1-32dddc54f51f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:22.187374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c04a8234-e596-437f-b6e1-32dddc54f51f tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.152523 Apr 19 03:55:22.187994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 674/1397] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:22 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:23.205561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fa0c7f35-529e-4331-ab63-91aa54c3ceae tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:23.206232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fa0c7f35-529e-4331-ab63-91aa54c3ceae tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:23.214028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fa0c7f35-529e-4331-ab63-91aa54c3ceae tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:23.214530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fa0c7f35-529e-4331-ab63-91aa54c3ceae tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:23.215419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fa0c7f35-529e-4331-ab63-91aa54c3ceae tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:23.215912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fa0c7f35-529e-4331-ab63-91aa54c3ceae tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:23.343728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fa0c7f35-529e-4331-ab63-91aa54c3ceae tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:23.352903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fa0c7f35-529e-4331-ab63-91aa54c3ceae tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.151510 Apr 19 03:55:23.353512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 724/1398] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:23 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:24.371857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cb18eec3-7126-4fdd-a8fb-b54e9d8c5d89 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:24.372582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cb18eec3-7126-4fdd-a8fb-b54e9d8c5d89 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:24.380533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb18eec3-7126-4fdd-a8fb-b54e9d8c5d89 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:24.381040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb18eec3-7126-4fdd-a8fb-b54e9d8c5d89 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:24.381870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb18eec3-7126-4fdd-a8fb-b54e9d8c5d89 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:24.382356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb18eec3-7126-4fdd-a8fb-b54e9d8c5d89 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:24.504759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cb18eec3-7126-4fdd-a8fb-b54e9d8c5d89 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:24.514535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cb18eec3-7126-4fdd-a8fb-b54e9d8c5d89 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147050 Apr 19 03:55:24.515172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 675/1399] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:24 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:25.532575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fe89a2f1-0119-429f-95d6-c1b382f63dec tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:25.533284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fe89a2f1-0119-429f-95d6-c1b382f63dec tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:25.541200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe89a2f1-0119-429f-95d6-c1b382f63dec tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:25.541710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe89a2f1-0119-429f-95d6-c1b382f63dec tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:25.542541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe89a2f1-0119-429f-95d6-c1b382f63dec tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:25.543034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe89a2f1-0119-429f-95d6-c1b382f63dec tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:25.665868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fe89a2f1-0119-429f-95d6-c1b382f63dec tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:25.675876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fe89a2f1-0119-429f-95d6-c1b382f63dec tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147404 Apr 19 03:55:25.676495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 725/1400] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:25 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:26.694026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-378ca4ff-fb6c-4ac2-8915-0c7633bd4734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:26.694701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-378ca4ff-fb6c-4ac2-8915-0c7633bd4734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:26.703370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-378ca4ff-fb6c-4ac2-8915-0c7633bd4734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:26.703871 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-378ca4ff-fb6c-4ac2-8915-0c7633bd4734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:26.704709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-378ca4ff-fb6c-4ac2-8915-0c7633bd4734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:26.705198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-378ca4ff-fb6c-4ac2-8915-0c7633bd4734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:26.827130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-378ca4ff-fb6c-4ac2-8915-0c7633bd4734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:26.836419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-378ca4ff-fb6c-4ac2-8915-0c7633bd4734 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146515 Apr 19 03:55:26.837029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 676/1401] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:26 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:27.854462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-09398bbd-3235-4a8d-b9d2-f168f6fdc6fc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:27.855065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-09398bbd-3235-4a8d-b9d2-f168f6fdc6fc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:27.862811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09398bbd-3235-4a8d-b9d2-f168f6fdc6fc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:27.863362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09398bbd-3235-4a8d-b9d2-f168f6fdc6fc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:27.864203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09398bbd-3235-4a8d-b9d2-f168f6fdc6fc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:27.864699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-09398bbd-3235-4a8d-b9d2-f168f6fdc6fc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:27.986368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-09398bbd-3235-4a8d-b9d2-f168f6fdc6fc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:27.995953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-09398bbd-3235-4a8d-b9d2-f168f6fdc6fc tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145726 Apr 19 03:55:27.996582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 726/1402] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:27 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:29.014109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e3718bdf-d7ec-4879-9b42-4a9a85c67932 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:29.015296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e3718bdf-d7ec-4879-9b42-4a9a85c67932 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:29.023277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3718bdf-d7ec-4879-9b42-4a9a85c67932 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:29.023789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3718bdf-d7ec-4879-9b42-4a9a85c67932 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:29.024622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3718bdf-d7ec-4879-9b42-4a9a85c67932 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:29.025113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3718bdf-d7ec-4879-9b42-4a9a85c67932 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:29.153556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e3718bdf-d7ec-4879-9b42-4a9a85c67932 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:29.163485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e3718bdf-d7ec-4879-9b42-4a9a85c67932 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.153463 Apr 19 03:55:29.164107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 677/1403] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:29 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:30.181098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ced0c864-3a68-4402-85f9-fcdc0b150bb9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:30.181770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ced0c864-3a68-4402-85f9-fcdc0b150bb9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:30.189644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ced0c864-3a68-4402-85f9-fcdc0b150bb9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:30.190150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ced0c864-3a68-4402-85f9-fcdc0b150bb9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:30.190987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ced0c864-3a68-4402-85f9-fcdc0b150bb9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:30.191510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ced0c864-3a68-4402-85f9-fcdc0b150bb9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:30.318777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ced0c864-3a68-4402-85f9-fcdc0b150bb9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:30.328042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ced0c864-3a68-4402-85f9-fcdc0b150bb9 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.151086 Apr 19 03:55:30.328662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 727/1404] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:30 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:31.346085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ee1072b4-45c4-4d96-972e-ca12ccc3f8ee tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:31.346754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ee1072b4-45c4-4d96-972e-ca12ccc3f8ee tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:31.354573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee1072b4-45c4-4d96-972e-ca12ccc3f8ee tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:31.355077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee1072b4-45c4-4d96-972e-ca12ccc3f8ee tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:31.355938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee1072b4-45c4-4d96-972e-ca12ccc3f8ee tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:31.356422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ee1072b4-45c4-4d96-972e-ca12ccc3f8ee tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:31.477809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ee1072b4-45c4-4d96-972e-ca12ccc3f8ee tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:31.487554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ee1072b4-45c4-4d96-972e-ca12ccc3f8ee tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.145553 Apr 19 03:55:31.488162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 678/1405] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:31 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:32.506200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4f808410-498a-437a-bc71-4b30c03b342d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:32.506868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4f808410-498a-437a-bc71-4b30c03b342d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:32.515318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f808410-498a-437a-bc71-4b30c03b342d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:32.515823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f808410-498a-437a-bc71-4b30c03b342d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:32.516649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f808410-498a-437a-bc71-4b30c03b342d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:32.517142 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4f808410-498a-437a-bc71-4b30c03b342d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:32.638729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4f808410-498a-437a-bc71-4b30c03b342d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:32.648818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4f808410-498a-437a-bc71-4b30c03b342d tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.146752 Apr 19 03:55:32.649430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 728/1406] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:32 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:33.667331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1159bd63-e4fc-4b12-bc82-10e54dc9b51e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:33.668019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1159bd63-e4fc-4b12-bc82-10e54dc9b51e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:33.675986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1159bd63-e4fc-4b12-bc82-10e54dc9b51e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:33.676499 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1159bd63-e4fc-4b12-bc82-10e54dc9b51e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:33.677339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1159bd63-e4fc-4b12-bc82-10e54dc9b51e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:33.677830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1159bd63-e4fc-4b12-bc82-10e54dc9b51e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:33.802548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1159bd63-e4fc-4b12-bc82-10e54dc9b51e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:33.812085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1159bd63-e4fc-4b12-bc82-10e54dc9b51e tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.148914 Apr 19 03:55:33.812704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 679/1407] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:33 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:34.830159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-25e7add0-4e5e-4da9-8eae-de7e8deed2f2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:34.830942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-25e7add0-4e5e-4da9-8eae-de7e8deed2f2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:34.839271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25e7add0-4e5e-4da9-8eae-de7e8deed2f2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:34.839271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25e7add0-4e5e-4da9-8eae-de7e8deed2f2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:34.840121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25e7add0-4e5e-4da9-8eae-de7e8deed2f2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:34.840611 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25e7add0-4e5e-4da9-8eae-de7e8deed2f2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:35.001106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-25e7add0-4e5e-4da9-8eae-de7e8deed2f2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:35.010486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-25e7add0-4e5e-4da9-8eae-de7e8deed2f2 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.184485 Apr 19 03:55:35.011099 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 729/1408] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:34 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:36.028971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1b9cc9bc-5f41-40b6-970b-64b476bd72e7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:36.029645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1b9cc9bc-5f41-40b6-970b-64b476bd72e7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:36.037655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1b9cc9bc-5f41-40b6-970b-64b476bd72e7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:36.038161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1b9cc9bc-5f41-40b6-970b-64b476bd72e7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:36.038992 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1b9cc9bc-5f41-40b6-970b-64b476bd72e7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:36.039512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1b9cc9bc-5f41-40b6-970b-64b476bd72e7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:36.167732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1b9cc9bc-5f41-40b6-970b-64b476bd72e7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:36.177633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1b9cc9bc-5f41-40b6-970b-64b476bd72e7 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.152764 Apr 19 03:55:36.178254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 680/1409] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:36 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:37.195708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3a6725d4-7602-404e-ad6d-65e5c9123b86 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:37.196378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3a6725d4-7602-404e-ad6d-65e5c9123b86 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:37.204890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a6725d4-7602-404e-ad6d-65e5c9123b86 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:37.205382 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a6725d4-7602-404e-ad6d-65e5c9123b86 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:37.206211 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a6725d4-7602-404e-ad6d-65e5c9123b86 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:37.206706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a6725d4-7602-404e-ad6d-65e5c9123b86 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:37.331124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3a6725d4-7602-404e-ad6d-65e5c9123b86 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:37.341131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3a6725d4-7602-404e-ad6d-65e5c9123b86 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.149579 Apr 19 03:55:37.341750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 730/1410] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:37 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:38.358268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6159f213-2dba-4fb6-87d2-bb9f3fde8e3c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:38.358955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6159f213-2dba-4fb6-87d2-bb9f3fde8e3c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:38.366690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6159f213-2dba-4fb6-87d2-bb9f3fde8e3c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:38.367221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6159f213-2dba-4fb6-87d2-bb9f3fde8e3c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:38.368046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6159f213-2dba-4fb6-87d2-bb9f3fde8e3c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:38.368781 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6159f213-2dba-4fb6-87d2-bb9f3fde8e3c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:38.627712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6159f213-2dba-4fb6-87d2-bb9f3fde8e3c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:38.637096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6159f213-2dba-4fb6-87d2-bb9f3fde8e3c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.282903 Apr 19 03:55:38.637708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 681/1411] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:38 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:39.656169 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-375a5174-b86a-4e58-87a6-d3f85796e49a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:39.656839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-375a5174-b86a-4e58-87a6-d3f85796e49a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:39.664661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-375a5174-b86a-4e58-87a6-d3f85796e49a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:39.665163 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-375a5174-b86a-4e58-87a6-d3f85796e49a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:39.665993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-375a5174-b86a-4e58-87a6-d3f85796e49a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:39.666482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-375a5174-b86a-4e58-87a6-d3f85796e49a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:39.791869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-375a5174-b86a-4e58-87a6-d3f85796e49a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:39.801194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-375a5174-b86a-4e58-87a6-d3f85796e49a tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.149770 Apr 19 03:55:39.801818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 731/1412] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:39 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:40.818522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dbf15a87-640d-42d0-ae73-a8aaf5749a11 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:40.819204 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dbf15a87-640d-42d0-ae73-a8aaf5749a11 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:40.826934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbf15a87-640d-42d0-ae73-a8aaf5749a11 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:40.827470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbf15a87-640d-42d0-ae73-a8aaf5749a11 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:40.828293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbf15a87-640d-42d0-ae73-a8aaf5749a11 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:40.828779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbf15a87-640d-42d0-ae73-a8aaf5749a11 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:40.951903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dbf15a87-640d-42d0-ae73-a8aaf5749a11 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:40.961568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dbf15a87-640d-42d0-ae73-a8aaf5749a11 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.147097 Apr 19 03:55:40.962541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 682/1413] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:40 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:41.980188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8473c776-67c2-4d93-aad7-6c35318dbef0 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:41.980872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8473c776-67c2-4d93-aad7-6c35318dbef0 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:41.989222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8473c776-67c2-4d93-aad7-6c35318dbef0 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:41.989734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8473c776-67c2-4d93-aad7-6c35318dbef0 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:41.990568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8473c776-67c2-4d93-aad7-6c35318dbef0 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:41.991062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8473c776-67c2-4d93-aad7-6c35318dbef0 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:42.154144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8473c776-67c2-4d93-aad7-6c35318dbef0 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:42.164785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8473c776-67c2-4d93-aad7-6c35318dbef0 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1389 microversion: 2.1 time: 0.188717 Apr 19 03:55:42.171709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cc7b8f26-6c3e-4a3e-aa8e-026b7eea8860 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] Calling method '.version_select at 0x7f9dac4ddc80>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:42.172004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 732/1414] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:41 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1389 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:42.213453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cc7b8f26-6c3e-4a3e-aa8e-026b7eea8860 tempest-TestVolumeBootPattern-1828019122 tempest-TestVolumeBootPattern-1828019122-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-785891168" status: 202 len: 0 microversion: 2.1 time: 0.046389 Apr 19 03:55:42.214046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 683/1415] 10.222.0.25 () {58 vars in 1250 bytes} [Mon Apr 19 03:55:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-785891168 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:55:43.182452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:43.183119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:43.191778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:43.192289 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:43.193121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:43.193608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:43.270087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:43.270592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:43.271103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.objects.instance [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lazy-loading 'fault' on Instance uuid 0eebf65c-de9c-4548-aab3-63d7c52a229c {{(pid=100591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 19 03:55:43.335030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '621dedc3d797460880325a84ad8c7d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66830e413293499db3998f9e797be69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:55:43.344393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bf676ed2-23ac-4120-9333-fc8bc9b2330c tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 200 len: 1483 microversion: 2.1 time: 0.166185 Apr 19 03:55:43.345017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 733/1416] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:43 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 1483 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:55:44.364671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-37c6177d-5863-49ef-ab95-7987f8bf5c56 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:44.364671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-37c6177d-5863-49ef-ab95-7987f8bf5c56 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] [instance: 0eebf65c-de9c-4548-aab3-63d7c52a229c] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:55:44.374316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37c6177d-5863-49ef-ab95-7987f8bf5c56 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:44.374896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37c6177d-5863-49ef-ab95-7987f8bf5c56 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:44.375826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37c6177d-5863-49ef-ab95-7987f8bf5c56 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:55:44.376355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-37c6177d-5863-49ef-ab95-7987f8bf5c56 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:55:44.430965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-37c6177d-5863-49ef-ab95-7987f8bf5c56 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] HTTP exception thrown: Instance 0eebf65c-de9c-4548-aab3-63d7c52a229c could not be found. Apr 19 03:55:44.431607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-37c6177d-5863-49ef-ab95-7987f8bf5c56 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Returning 404 to user: Instance 0eebf65c-de9c-4548-aab3-63d7c52a229c could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:55:44.432502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-37c6177d-5863-49ef-ab95-7987f8bf5c56 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c" status: 404 len: 111 microversion: 2.1 time: 0.074318 Apr 19 03:55:44.433103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 684/1417] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:55:44 2021] GET /compute/v2.1/servers/0eebf65c-de9c-4548-aab3-63d7c52a229c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:55:44.442249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b12c5ea5-acbd-4fd3-ad12-7e9070581289 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] Calling method '.version_select at 0x7f9db100ed90>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:55:44.514912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b12c5ea5-acbd-4fd3-ad12-7e9070581289 tempest-TestMinimumBasicScenario-1919319545 tempest-TestMinimumBasicScenario-1919319545-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-479093726" status: 202 len: 0 microversion: 2.1 time: 0.075919 Apr 19 03:55:44.515593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 734/1418] 10.222.0.25 () {58 vars in 1259 bytes} [Mon Apr 19 03:55:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-479093726 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 03:56:26.801921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:56:26.802384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:56:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:56:28.073013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:56:28.073509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:56:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:56:46.418739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:56:46.419277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:56:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:56:48.302906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8143c165-af1e-444f-92ef-c10819601783 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:56:48.303493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8143c165-af1e-444f-92ef-c10819601783 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:56:48.311325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8143c165-af1e-444f-92ef-c10819601783 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:48.311828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8143c165-af1e-444f-92ef-c10819601783 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:48.312657 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8143c165-af1e-444f-92ef-c10819601783 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:48.313151 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8143c165-af1e-444f-92ef-c10819601783 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:48.377573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8143c165-af1e-444f-92ef-c10819601783 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:56:48.532800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8143c165-af1e-444f-92ef-c10819601783 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [e967043d-a773-45ac-9a41-ad4d77f889e0] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 19 03:56:49.548943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [None req-8143c165-af1e-444f-92ef-c10819601783 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [e967043d-a773-45ac-9a41-ad4d77f889e0] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42124. Apr 19 03:56:49.608242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8143c165-af1e-444f-92ef-c10819601783 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "DELETE /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 204 len: 0 microversion: 2.1 time: 1.309428 Apr 19 03:56:49.608884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 685/1419] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:56:48 2021] DELETE /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 0 bytes in 1311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:56:49.617810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-77ad2a24-c712-4c40-9903-ea6e05757364 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:56:49.618475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-77ad2a24-c712-4c40-9903-ea6e05757364 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:56:49.627810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77ad2a24-c712-4c40-9903-ea6e05757364 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:49.628315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77ad2a24-c712-4c40-9903-ea6e05757364 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:49.629137 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77ad2a24-c712-4c40-9903-ea6e05757364 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:49.629628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77ad2a24-c712-4c40-9903-ea6e05757364 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:49.837590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-77ad2a24-c712-4c40-9903-ea6e05757364 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:56:49.847022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-77ad2a24-c712-4c40-9903-ea6e05757364 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1560 microversion: 2.1 time: 0.233505 Apr 19 03:56:49.847721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 735/1420] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:56:49 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:56:50.866482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7f083128-0ffe-4e46-b0f9-5d8e41d0a1d3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:56:50.868006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7f083128-0ffe-4e46-b0f9-5d8e41d0a1d3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:56:50.876714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f083128-0ffe-4e46-b0f9-5d8e41d0a1d3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:50.877219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f083128-0ffe-4e46-b0f9-5d8e41d0a1d3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:50.878062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f083128-0ffe-4e46-b0f9-5d8e41d0a1d3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:50.878557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7f083128-0ffe-4e46-b0f9-5d8e41d0a1d3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:51.102969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7f083128-0ffe-4e46-b0f9-5d8e41d0a1d3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:56:51.112467 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7f083128-0ffe-4e46-b0f9-5d8e41d0a1d3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1560 microversion: 2.1 time: 0.250714 Apr 19 03:56:51.113088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 686/1421] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:56:50 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1560 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:56:51.496134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-2c8a2de6-551f-4836-a222-79b80ca96616 req-43f49f58-f420-4122-a282-cd2adbe135be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399e1abb-7255-4f6f-b038-2fbfe20f7b3e", "name": "network-vif-deleted", "tag": "b227a3dd-c555-40c8-8a99-11f7d9fccca6"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:56:51.497882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:56:51.497882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:56:51.507314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-2c8a2de6-551f-4836-a222-79b80ca96616 req-43f49f58-f420-4122-a282-cd2adbe135be service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:51.507809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-2c8a2de6-551f-4836-a222-79b80ca96616 req-43f49f58-f420-4122-a282-cd2adbe135be service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:51.524621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-2c8a2de6-551f-4836-a222-79b80ca96616 req-43f49f58-f420-4122-a282-cd2adbe135be service nova] Creating event network-vif-deleted:b227a3dd-c555-40c8-8a99-11f7d9fccca6 for instance 399e1abb-7255-4f6f-b038-2fbfe20f7b3e on hv-cinder-78605 Apr 19 03:56:51.531516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-2c8a2de6-551f-4836-a222-79b80ca96616 req-43f49f58-f420-4122-a282-cd2adbe135be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193964 Apr 19 03:56:51.532215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 736/1422] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:56:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:56:52.130777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b4a5992c-e34a-4553-b281-a7718143780a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:56:52.131502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b4a5992c-e34a-4553-b281-a7718143780a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:56:52.139356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b4a5992c-e34a-4553-b281-a7718143780a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:52.139868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b4a5992c-e34a-4553-b281-a7718143780a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:52.140715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b4a5992c-e34a-4553-b281-a7718143780a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:52.141196 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b4a5992c-e34a-4553-b281-a7718143780a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:52.266538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b4a5992c-e34a-4553-b281-a7718143780a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:56:52.275881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b4a5992c-e34a-4553-b281-a7718143780a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149216 Apr 19 03:56:52.276499 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 687/1423] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:56:52 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:56:53.294564 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c2091495-c94e-49cc-bca2-ee29e344768f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:56:53.295370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c2091495-c94e-49cc-bca2-ee29e344768f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:56:53.304053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2091495-c94e-49cc-bca2-ee29e344768f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:53.304562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2091495-c94e-49cc-bca2-ee29e344768f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:53.305393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2091495-c94e-49cc-bca2-ee29e344768f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:53.305880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c2091495-c94e-49cc-bca2-ee29e344768f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:53.465970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c2091495-c94e-49cc-bca2-ee29e344768f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:56:53.475802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c2091495-c94e-49cc-bca2-ee29e344768f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.185833 Apr 19 03:56:53.476418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 737/1424] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:56:53 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:56:54.494850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f7519cbb-57a9-4178-939e-4b323cdf09c7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:56:54.495596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f7519cbb-57a9-4178-939e-4b323cdf09c7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:56:54.504063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7519cbb-57a9-4178-939e-4b323cdf09c7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:54.504568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7519cbb-57a9-4178-939e-4b323cdf09c7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:54.505389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7519cbb-57a9-4178-939e-4b323cdf09c7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:54.505873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7519cbb-57a9-4178-939e-4b323cdf09c7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:54.628368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f7519cbb-57a9-4178-939e-4b323cdf09c7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:56:54.637682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f7519cbb-57a9-4178-939e-4b323cdf09c7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.147269 Apr 19 03:56:54.638276 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 688/1425] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:56:54 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:56:55.655769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e84c12e7-96f9-4bd7-9270-b17f02f8fe16 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:56:55.656435 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e84c12e7-96f9-4bd7-9270-b17f02f8fe16 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:56:55.664232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e84c12e7-96f9-4bd7-9270-b17f02f8fe16 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:55.664734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e84c12e7-96f9-4bd7-9270-b17f02f8fe16 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:55.665551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e84c12e7-96f9-4bd7-9270-b17f02f8fe16 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:55.666033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e84c12e7-96f9-4bd7-9270-b17f02f8fe16 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:55.793033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e84c12e7-96f9-4bd7-9270-b17f02f8fe16 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:56:55.802231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e84c12e7-96f9-4bd7-9270-b17f02f8fe16 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150748 Apr 19 03:56:55.802839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 738/1426] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:56:55 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:56:56.820972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-27be8b75-1974-41a2-a60a-df9a2d368ae5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:56:56.821542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-27be8b75-1974-41a2-a60a-df9a2d368ae5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:56:56.829886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27be8b75-1974-41a2-a60a-df9a2d368ae5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:56.830387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27be8b75-1974-41a2-a60a-df9a2d368ae5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:56.831235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27be8b75-1974-41a2-a60a-df9a2d368ae5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:56.831726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-27be8b75-1974-41a2-a60a-df9a2d368ae5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:56.956270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-27be8b75-1974-41a2-a60a-df9a2d368ae5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:56:56.965679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-27be8b75-1974-41a2-a60a-df9a2d368ae5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148944 Apr 19 03:56:56.966292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 689/1427] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:56:56 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:56:57.985398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-da34dff1-443e-4889-b4d3-5234cf8eba83 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:56:57.986067 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-da34dff1-443e-4889-b4d3-5234cf8eba83 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:56:57.993979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da34dff1-443e-4889-b4d3-5234cf8eba83 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:57.994745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da34dff1-443e-4889-b4d3-5234cf8eba83 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:57.995600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da34dff1-443e-4889-b4d3-5234cf8eba83 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:57.996141 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da34dff1-443e-4889-b4d3-5234cf8eba83 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:58.121329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-da34dff1-443e-4889-b4d3-5234cf8eba83 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:56:58.130778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-da34dff1-443e-4889-b4d3-5234cf8eba83 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150057 Apr 19 03:56:58.131444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 739/1428] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:56:57 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:56:59.148302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-52e6ba08-cb64-4caa-b8d1-7df5cc1d2afd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:56:59.148978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-52e6ba08-cb64-4caa-b8d1-7df5cc1d2afd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:56:59.156901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52e6ba08-cb64-4caa-b8d1-7df5cc1d2afd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:59.157408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52e6ba08-cb64-4caa-b8d1-7df5cc1d2afd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:59.158237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52e6ba08-cb64-4caa-b8d1-7df5cc1d2afd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:56:59.158725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52e6ba08-cb64-4caa-b8d1-7df5cc1d2afd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:56:59.284437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-52e6ba08-cb64-4caa-b8d1-7df5cc1d2afd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:56:59.293688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-52e6ba08-cb64-4caa-b8d1-7df5cc1d2afd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149523 Apr 19 03:56:59.294304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 690/1429] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:56:59 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:00.311215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-65bf4ad5-93f3-47eb-bdeb-7a5e2964d00b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:00.311895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-65bf4ad5-93f3-47eb-bdeb-7a5e2964d00b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:00.319676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65bf4ad5-93f3-47eb-bdeb-7a5e2964d00b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:00.320187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65bf4ad5-93f3-47eb-bdeb-7a5e2964d00b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:00.321018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65bf4ad5-93f3-47eb-bdeb-7a5e2964d00b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:00.321507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-65bf4ad5-93f3-47eb-bdeb-7a5e2964d00b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:00.444191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-65bf4ad5-93f3-47eb-bdeb-7a5e2964d00b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:00.453913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-65bf4ad5-93f3-47eb-bdeb-7a5e2964d00b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146814 Apr 19 03:57:00.454526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 740/1430] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:00 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:01.472064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-31b6f7b0-6d8f-48db-acfb-aedfcb5c6a23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:01.472875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-31b6f7b0-6d8f-48db-acfb-aedfcb5c6a23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:01.480693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31b6f7b0-6d8f-48db-acfb-aedfcb5c6a23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:01.481197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31b6f7b0-6d8f-48db-acfb-aedfcb5c6a23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:01.482028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31b6f7b0-6d8f-48db-acfb-aedfcb5c6a23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:01.482518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-31b6f7b0-6d8f-48db-acfb-aedfcb5c6a23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:01.604835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-31b6f7b0-6d8f-48db-acfb-aedfcb5c6a23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:01.614915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-31b6f7b0-6d8f-48db-acfb-aedfcb5c6a23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.147049 Apr 19 03:57:01.615557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 691/1431] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:01 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:02.633205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-35981654-5ecb-4189-9835-ebc90115df23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:02.633872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-35981654-5ecb-4189-9835-ebc90115df23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:02.642325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35981654-5ecb-4189-9835-ebc90115df23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:02.642829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35981654-5ecb-4189-9835-ebc90115df23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:02.643670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35981654-5ecb-4189-9835-ebc90115df23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:02.644154 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35981654-5ecb-4189-9835-ebc90115df23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:02.905497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-35981654-5ecb-4189-9835-ebc90115df23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:02.914859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-35981654-5ecb-4189-9835-ebc90115df23 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.285771 Apr 19 03:57:02.915512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 741/1432] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:02 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:03.933396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e70053eb-ff37-4e8b-968d-6b9df35f5274 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:03.934067 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e70053eb-ff37-4e8b-968d-6b9df35f5274 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:03.942688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e70053eb-ff37-4e8b-968d-6b9df35f5274 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:03.943222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e70053eb-ff37-4e8b-968d-6b9df35f5274 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:03.944055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e70053eb-ff37-4e8b-968d-6b9df35f5274 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:03.944547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e70053eb-ff37-4e8b-968d-6b9df35f5274 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:04.070677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e70053eb-ff37-4e8b-968d-6b9df35f5274 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:04.080639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e70053eb-ff37-4e8b-968d-6b9df35f5274 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.151409 Apr 19 03:57:04.081249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 692/1433] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:03 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:05.099136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6c8022e4-04a9-4c78-ab4e-d480ccef7b24 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:05.099923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6c8022e4-04a9-4c78-ab4e-d480ccef7b24 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:05.107724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c8022e4-04a9-4c78-ab4e-d480ccef7b24 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:05.108238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c8022e4-04a9-4c78-ab4e-d480ccef7b24 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:05.109068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c8022e4-04a9-4c78-ab4e-d480ccef7b24 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:05.109559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6c8022e4-04a9-4c78-ab4e-d480ccef7b24 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:05.230620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6c8022e4-04a9-4c78-ab4e-d480ccef7b24 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:05.239907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6c8022e4-04a9-4c78-ab4e-d480ccef7b24 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.144981 Apr 19 03:57:05.240509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 742/1434] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:05 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:06.258035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f8b881a9-1a05-46f9-a776-a4f40221e19c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:06.258709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f8b881a9-1a05-46f9-a776-a4f40221e19c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:06.266462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8b881a9-1a05-46f9-a776-a4f40221e19c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:06.266955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8b881a9-1a05-46f9-a776-a4f40221e19c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:06.267810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8b881a9-1a05-46f9-a776-a4f40221e19c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:06.268297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8b881a9-1a05-46f9-a776-a4f40221e19c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:06.395216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f8b881a9-1a05-46f9-a776-a4f40221e19c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:06.405128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f8b881a9-1a05-46f9-a776-a4f40221e19c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150625 Apr 19 03:57:06.405750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 693/1435] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:06 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:07.423581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d65868c0-7915-42bd-aae3-dad481fa8eba tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:07.424254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d65868c0-7915-42bd-aae3-dad481fa8eba tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:07.432083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d65868c0-7915-42bd-aae3-dad481fa8eba tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:07.432592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d65868c0-7915-42bd-aae3-dad481fa8eba tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:07.433426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d65868c0-7915-42bd-aae3-dad481fa8eba tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:07.433920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d65868c0-7915-42bd-aae3-dad481fa8eba tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:07.558756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d65868c0-7915-42bd-aae3-dad481fa8eba tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:07.568539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d65868c0-7915-42bd-aae3-dad481fa8eba tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149520 Apr 19 03:57:07.569152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 743/1436] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:07 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:08.586693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-947d343f-c55d-4f8c-a181-1d912542665a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:08.587395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-947d343f-c55d-4f8c-a181-1d912542665a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:08.595502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-947d343f-c55d-4f8c-a181-1d912542665a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:08.595987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-947d343f-c55d-4f8c-a181-1d912542665a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:08.596812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-947d343f-c55d-4f8c-a181-1d912542665a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:08.597311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-947d343f-c55d-4f8c-a181-1d912542665a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:08.719427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-947d343f-c55d-4f8c-a181-1d912542665a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:08.728629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-947d343f-c55d-4f8c-a181-1d912542665a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146168 Apr 19 03:57:08.729236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 694/1437] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:08 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:09.747684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7c5dd581-14f4-4add-8853-4271ddc0794e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:09.748348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7c5dd581-14f4-4add-8853-4271ddc0794e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:09.756234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c5dd581-14f4-4add-8853-4271ddc0794e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:09.756737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c5dd581-14f4-4add-8853-4271ddc0794e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:09.757560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c5dd581-14f4-4add-8853-4271ddc0794e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:09.758050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c5dd581-14f4-4add-8853-4271ddc0794e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:09.886464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7c5dd581-14f4-4add-8853-4271ddc0794e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:09.896364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7c5dd581-14f4-4add-8853-4271ddc0794e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.153213 Apr 19 03:57:09.896970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 744/1438] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:09 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:10.914051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1537dbd1-5171-4992-98ed-1d6c27bc9c45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:10.914731 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1537dbd1-5171-4992-98ed-1d6c27bc9c45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:10.923105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1537dbd1-5171-4992-98ed-1d6c27bc9c45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:10.923650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1537dbd1-5171-4992-98ed-1d6c27bc9c45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:10.924468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1537dbd1-5171-4992-98ed-1d6c27bc9c45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:10.924961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1537dbd1-5171-4992-98ed-1d6c27bc9c45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:11.048901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1537dbd1-5171-4992-98ed-1d6c27bc9c45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:11.058064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1537dbd1-5171-4992-98ed-1d6c27bc9c45 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148061 Apr 19 03:57:11.058678 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 695/1439] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:10 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:12.076218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-85783512-6d30-4256-bc38-cb76617dd4f6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:12.076934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-85783512-6d30-4256-bc38-cb76617dd4f6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:12.084717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-85783512-6d30-4256-bc38-cb76617dd4f6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:12.085230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-85783512-6d30-4256-bc38-cb76617dd4f6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:12.086071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-85783512-6d30-4256-bc38-cb76617dd4f6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:12.086567 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-85783512-6d30-4256-bc38-cb76617dd4f6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:12.210921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-85783512-6d30-4256-bc38-cb76617dd4f6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:12.220779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-85783512-6d30-4256-bc38-cb76617dd4f6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148674 Apr 19 03:57:12.221390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 745/1440] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:12 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:13.239123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8fef628c-bc60-45d2-b931-f8333ae5dff2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:13.239822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8fef628c-bc60-45d2-b931-f8333ae5dff2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:13.247861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8fef628c-bc60-45d2-b931-f8333ae5dff2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:13.248927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8fef628c-bc60-45d2-b931-f8333ae5dff2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:13.249751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8fef628c-bc60-45d2-b931-f8333ae5dff2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:13.250235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8fef628c-bc60-45d2-b931-f8333ae5dff2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:13.374863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8fef628c-bc60-45d2-b931-f8333ae5dff2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:13.384156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8fef628c-bc60-45d2-b931-f8333ae5dff2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149112 Apr 19 03:57:13.384768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 696/1441] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:13 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:14.402246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-68dd6841-cddd-4617-b920-274e8cd2ae74 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:14.402915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-68dd6841-cddd-4617-b920-274e8cd2ae74 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:14.410741 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68dd6841-cddd-4617-b920-274e8cd2ae74 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:14.412365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68dd6841-cddd-4617-b920-274e8cd2ae74 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:14.412365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68dd6841-cddd-4617-b920-274e8cd2ae74 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:14.412578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68dd6841-cddd-4617-b920-274e8cd2ae74 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:14.533823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-68dd6841-cddd-4617-b920-274e8cd2ae74 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:14.543254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-68dd6841-cddd-4617-b920-274e8cd2ae74 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.145071 Apr 19 03:57:14.543854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 746/1442] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:14 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:15.561721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3053f7ce-3273-44dc-9815-210f6a1d45a5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:15.562396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3053f7ce-3273-44dc-9815-210f6a1d45a5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:15.570454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3053f7ce-3273-44dc-9815-210f6a1d45a5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:15.570961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3053f7ce-3273-44dc-9815-210f6a1d45a5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:15.571823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3053f7ce-3273-44dc-9815-210f6a1d45a5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:15.572315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3053f7ce-3273-44dc-9815-210f6a1d45a5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:15.695228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3053f7ce-3273-44dc-9815-210f6a1d45a5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:15.705546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3053f7ce-3273-44dc-9815-210f6a1d45a5 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148041 Apr 19 03:57:15.706177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 697/1443] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:15 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:16.723621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4e72dc07-e823-4cc3-ac03-81175ca75e47 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:16.724289 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4e72dc07-e823-4cc3-ac03-81175ca75e47 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:16.732079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4e72dc07-e823-4cc3-ac03-81175ca75e47 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:16.733177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4e72dc07-e823-4cc3-ac03-81175ca75e47 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:16.734001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4e72dc07-e823-4cc3-ac03-81175ca75e47 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:16.734484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4e72dc07-e823-4cc3-ac03-81175ca75e47 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:16.863240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4e72dc07-e823-4cc3-ac03-81175ca75e47 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:16.873001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4e72dc07-e823-4cc3-ac03-81175ca75e47 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.153627 Apr 19 03:57:16.873606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 747/1444] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:16 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:17.890166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4da878a1-82fa-4a30-bfc0-f15f88a694e3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:17.890948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4da878a1-82fa-4a30-bfc0-f15f88a694e3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:17.898840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4da878a1-82fa-4a30-bfc0-f15f88a694e3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:17.899810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4da878a1-82fa-4a30-bfc0-f15f88a694e3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:17.900235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4da878a1-82fa-4a30-bfc0-f15f88a694e3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:17.900760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4da878a1-82fa-4a30-bfc0-f15f88a694e3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:18.026152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4da878a1-82fa-4a30-bfc0-f15f88a694e3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:18.035838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4da878a1-82fa-4a30-bfc0-f15f88a694e3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149811 Apr 19 03:57:18.036448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 698/1445] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:17 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:18.291543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c8c6bcfe-559d-427f-b742-28bb62645d63 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:18.292091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c8c6bcfe-559d-427f-b742-28bb62645d63 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:18.300489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8c6bcfe-559d-427f-b742-28bb62645d63 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:18.300989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8c6bcfe-559d-427f-b742-28bb62645d63 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:18.301811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8c6bcfe-559d-427f-b742-28bb62645d63 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:18.302297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c8c6bcfe-559d-427f-b742-28bb62645d63 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:18.354027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-c8c6bcfe-559d-427f-b742-28bb62645d63 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] HTTP exception thrown: Instance 7b970f17-73a6-4e13-845d-a2ead7223a67 could not be found. Apr 19 03:57:18.354666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c8c6bcfe-559d-427f-b742-28bb62645d63 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Returning 404 to user: Instance 7b970f17-73a6-4e13-845d-a2ead7223a67 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:57:18.355560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c8c6bcfe-559d-427f-b742-28bb62645d63 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 404 len: 111 microversion: 2.1 time: 0.068081 Apr 19 03:57:18.356131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 748/1446] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:57:18 2021] DELETE /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:57:18.365273 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-96f23d17-f71c-43ff-9218-6fd48bd4f0c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:18.365953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-96f23d17-f71c-43ff-9218-6fd48bd4f0c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: 7b970f17-73a6-4e13-845d-a2ead7223a67] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:18.374028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96f23d17-f71c-43ff-9218-6fd48bd4f0c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:18.374546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96f23d17-f71c-43ff-9218-6fd48bd4f0c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:18.375441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96f23d17-f71c-43ff-9218-6fd48bd4f0c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:18.375933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96f23d17-f71c-43ff-9218-6fd48bd4f0c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:18.428390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-96f23d17-f71c-43ff-9218-6fd48bd4f0c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] HTTP exception thrown: Instance 7b970f17-73a6-4e13-845d-a2ead7223a67 could not be found. Apr 19 03:57:18.429048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-96f23d17-f71c-43ff-9218-6fd48bd4f0c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Returning 404 to user: Instance 7b970f17-73a6-4e13-845d-a2ead7223a67 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:57:18.429933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-96f23d17-f71c-43ff-9218-6fd48bd4f0c7 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67" status: 404 len: 111 microversion: 2.1 time: 0.068931 Apr 19 03:57:18.430513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 699/1447] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:18 2021] GET /compute/v2.1/servers/7b970f17-73a6-4e13-845d-a2ead7223a67 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:57:19.054179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-350e16ea-85f8-43d3-822f-398d7258e3fb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:19.054851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-350e16ea-85f8-43d3-822f-398d7258e3fb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:19.063239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-350e16ea-85f8-43d3-822f-398d7258e3fb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:19.063747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-350e16ea-85f8-43d3-822f-398d7258e3fb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:19.064561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-350e16ea-85f8-43d3-822f-398d7258e3fb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:19.065376 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-350e16ea-85f8-43d3-822f-398d7258e3fb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:19.185984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-350e16ea-85f8-43d3-822f-398d7258e3fb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:19.195213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-350e16ea-85f8-43d3-822f-398d7258e3fb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.145081 Apr 19 03:57:19.195818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 749/1448] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:19 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:20.213203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8409b918-bc18-463d-8370-2de94138bae1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:20.213878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8409b918-bc18-463d-8370-2de94138bae1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:20.222237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8409b918-bc18-463d-8370-2de94138bae1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:20.222743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8409b918-bc18-463d-8370-2de94138bae1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:20.223623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8409b918-bc18-463d-8370-2de94138bae1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:20.224117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8409b918-bc18-463d-8370-2de94138bae1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:20.348821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8409b918-bc18-463d-8370-2de94138bae1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:20.358078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8409b918-bc18-463d-8370-2de94138bae1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149006 Apr 19 03:57:20.358699 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 700/1449] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:20 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:21.376414 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0c7aff54-aefb-4f8b-94d4-6952c14a0d3c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:21.382595 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0c7aff54-aefb-4f8b-94d4-6952c14a0d3c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:21.385011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c7aff54-aefb-4f8b-94d4-6952c14a0d3c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:21.385521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c7aff54-aefb-4f8b-94d4-6952c14a0d3c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:21.386349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c7aff54-aefb-4f8b-94d4-6952c14a0d3c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:21.386843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c7aff54-aefb-4f8b-94d4-6952c14a0d3c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:21.508531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0c7aff54-aefb-4f8b-94d4-6952c14a0d3c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:21.518321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0c7aff54-aefb-4f8b-94d4-6952c14a0d3c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.145953 Apr 19 03:57:21.518933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 750/1450] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:21 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:22.536384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4969d9a4-6ff6-40c7-bf6d-a8e0ae1387ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:22.537059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4969d9a4-6ff6-40c7-bf6d-a8e0ae1387ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:22.545565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4969d9a4-6ff6-40c7-bf6d-a8e0ae1387ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:22.546073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4969d9a4-6ff6-40c7-bf6d-a8e0ae1387ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:22.546908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4969d9a4-6ff6-40c7-bf6d-a8e0ae1387ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:22.547446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4969d9a4-6ff6-40c7-bf6d-a8e0ae1387ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:22.669175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4969d9a4-6ff6-40c7-bf6d-a8e0ae1387ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:22.679059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4969d9a4-6ff6-40c7-bf6d-a8e0ae1387ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146774 Apr 19 03:57:22.679698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 701/1451] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:22 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:23.696840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c388c600-07c5-4608-8a91-634f1c2de1fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:23.697514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c388c600-07c5-4608-8a91-634f1c2de1fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:23.705675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c388c600-07c5-4608-8a91-634f1c2de1fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:23.706234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c388c600-07c5-4608-8a91-634f1c2de1fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:23.707069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c388c600-07c5-4608-8a91-634f1c2de1fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:23.707590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c388c600-07c5-4608-8a91-634f1c2de1fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:23.836446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c388c600-07c5-4608-8a91-634f1c2de1fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:23.845761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c388c600-07c5-4608-8a91-634f1c2de1fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.153084 Apr 19 03:57:23.846332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 751/1452] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:23 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:24.863797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ea0531f3-7299-401b-8ccd-bcba0a367d14 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:24.864484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ea0531f3-7299-401b-8ccd-bcba0a367d14 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:24.873005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea0531f3-7299-401b-8ccd-bcba0a367d14 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:24.873521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea0531f3-7299-401b-8ccd-bcba0a367d14 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:24.874356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea0531f3-7299-401b-8ccd-bcba0a367d14 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:24.874861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ea0531f3-7299-401b-8ccd-bcba0a367d14 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:25.000006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ea0531f3-7299-401b-8ccd-bcba0a367d14 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:25.009285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ea0531f3-7299-401b-8ccd-bcba0a367d14 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149592 Apr 19 03:57:25.009901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 702/1453] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:24 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:26.027615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-35bf567b-13f9-484f-bfe4-3373320f1221 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:26.028290 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-35bf567b-13f9-484f-bfe4-3373320f1221 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:26.036767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35bf567b-13f9-484f-bfe4-3373320f1221 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:26.037279 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35bf567b-13f9-484f-bfe4-3373320f1221 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:26.038116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35bf567b-13f9-484f-bfe4-3373320f1221 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:26.038609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35bf567b-13f9-484f-bfe4-3373320f1221 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:26.160021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-35bf567b-13f9-484f-bfe4-3373320f1221 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:26.169301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-35bf567b-13f9-484f-bfe4-3373320f1221 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.145823 Apr 19 03:57:26.169917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 752/1454] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:26 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:27.187462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-056a15a9-7f3a-42ae-adfc-e9a3d0579602 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:27.188180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-056a15a9-7f3a-42ae-adfc-e9a3d0579602 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:27.195958 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-056a15a9-7f3a-42ae-adfc-e9a3d0579602 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:27.196455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-056a15a9-7f3a-42ae-adfc-e9a3d0579602 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:27.197272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-056a15a9-7f3a-42ae-adfc-e9a3d0579602 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:27.197754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-056a15a9-7f3a-42ae-adfc-e9a3d0579602 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:27.322345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-056a15a9-7f3a-42ae-adfc-e9a3d0579602 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:27.332046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-056a15a9-7f3a-42ae-adfc-e9a3d0579602 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148232 Apr 19 03:57:27.332655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 703/1455] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:27 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:28.350251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-efb9a1f7-6bb3-4d03-9182-35ce1a3990ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:28.350915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-efb9a1f7-6bb3-4d03-9182-35ce1a3990ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:28.359252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efb9a1f7-6bb3-4d03-9182-35ce1a3990ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:28.359759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efb9a1f7-6bb3-4d03-9182-35ce1a3990ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:28.360584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efb9a1f7-6bb3-4d03-9182-35ce1a3990ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:28.361067 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-efb9a1f7-6bb3-4d03-9182-35ce1a3990ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:28.484883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-efb9a1f7-6bb3-4d03-9182-35ce1a3990ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:28.501600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-efb9a1f7-6bb3-4d03-9182-35ce1a3990ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148298 Apr 19 03:57:28.501600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 753/1456] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:28 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:29.514064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0b82f672-35bd-4c57-ada8-df90fac56e6e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:29.514742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0b82f672-35bd-4c57-ada8-df90fac56e6e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:29.522708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b82f672-35bd-4c57-ada8-df90fac56e6e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:29.523246 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b82f672-35bd-4c57-ada8-df90fac56e6e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:29.524087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b82f672-35bd-4c57-ada8-df90fac56e6e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:29.524579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b82f672-35bd-4c57-ada8-df90fac56e6e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:29.648609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0b82f672-35bd-4c57-ada8-df90fac56e6e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:29.657968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0b82f672-35bd-4c57-ada8-df90fac56e6e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148645 Apr 19 03:57:29.658582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 704/1457] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:29 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:30.675730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a506ee58-1624-40de-aa1a-b6746b6910a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:30.676620 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a506ee58-1624-40de-aa1a-b6746b6910a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:30.684416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a506ee58-1624-40de-aa1a-b6746b6910a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:30.684985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a506ee58-1624-40de-aa1a-b6746b6910a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:30.685791 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a506ee58-1624-40de-aa1a-b6746b6910a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:30.686300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a506ee58-1624-40de-aa1a-b6746b6910a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:30.813667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a506ee58-1624-40de-aa1a-b6746b6910a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:30.822874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a506ee58-1624-40de-aa1a-b6746b6910a9 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.151273 Apr 19 03:57:30.823533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 754/1458] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:30 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:31.840889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8b049a60-3011-4388-aa0b-64fb16852c0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:31.842134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8b049a60-3011-4388-aa0b-64fb16852c0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:31.849993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b049a60-3011-4388-aa0b-64fb16852c0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:31.850452 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b049a60-3011-4388-aa0b-64fb16852c0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:31.851308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b049a60-3011-4388-aa0b-64fb16852c0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:31.851798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b049a60-3011-4388-aa0b-64fb16852c0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:31.976462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8b049a60-3011-4388-aa0b-64fb16852c0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:31.986346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8b049a60-3011-4388-aa0b-64fb16852c0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149556 Apr 19 03:57:31.986957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 705/1459] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:31 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:33.004716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bd84a3e6-f233-49a4-8463-0870e51b0e0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:33.005378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bd84a3e6-f233-49a4-8463-0870e51b0e0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:33.013597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd84a3e6-f233-49a4-8463-0870e51b0e0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:33.014102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd84a3e6-f233-49a4-8463-0870e51b0e0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:33.014930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd84a3e6-f233-49a4-8463-0870e51b0e0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:33.015441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd84a3e6-f233-49a4-8463-0870e51b0e0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:33.136738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bd84a3e6-f233-49a4-8463-0870e51b0e0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:33.146604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bd84a3e6-f233-49a4-8463-0870e51b0e0d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146000 Apr 19 03:57:33.147230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 755/1460] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:32 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:34.164641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f0bbcf33-a564-4aa5-9e61-46602eef2ab6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:34.165348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f0bbcf33-a564-4aa5-9e61-46602eef2ab6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:34.173855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0bbcf33-a564-4aa5-9e61-46602eef2ab6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:34.174300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0bbcf33-a564-4aa5-9e61-46602eef2ab6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:34.175118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0bbcf33-a564-4aa5-9e61-46602eef2ab6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:34.175629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f0bbcf33-a564-4aa5-9e61-46602eef2ab6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:34.543765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f0bbcf33-a564-4aa5-9e61-46602eef2ab6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:34.553312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f0bbcf33-a564-4aa5-9e61-46602eef2ab6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.392714 Apr 19 03:57:34.553924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 706/1461] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:34 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:35.576780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-da6bce40-a8eb-4172-972a-ed8affcd64fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:35.577450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-da6bce40-a8eb-4172-972a-ed8affcd64fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:35.585258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da6bce40-a8eb-4172-972a-ed8affcd64fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:35.585763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da6bce40-a8eb-4172-972a-ed8affcd64fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:35.586610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da6bce40-a8eb-4172-972a-ed8affcd64fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:35.587094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da6bce40-a8eb-4172-972a-ed8affcd64fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:35.709216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-da6bce40-a8eb-4172-972a-ed8affcd64fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:35.719067 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-da6bce40-a8eb-4172-972a-ed8affcd64fd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146333 Apr 19 03:57:35.719736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 756/1462] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:35 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:36.737752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bfb6969b-60f4-4f08-9967-1ea1252f90e4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:36.738357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bfb6969b-60f4-4f08-9967-1ea1252f90e4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:36.746722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfb6969b-60f4-4f08-9967-1ea1252f90e4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:36.746857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfb6969b-60f4-4f08-9967-1ea1252f90e4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:36.748382 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfb6969b-60f4-4f08-9967-1ea1252f90e4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:36.748875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfb6969b-60f4-4f08-9967-1ea1252f90e4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:36.870983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bfb6969b-60f4-4f08-9967-1ea1252f90e4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:36.880360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bfb6969b-60f4-4f08-9967-1ea1252f90e4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146816 Apr 19 03:57:36.881201 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 707/1463] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:36 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:37.898205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bc32200d-6a44-48dc-8eff-dd04302d26b8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:37.898844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bc32200d-6a44-48dc-8eff-dd04302d26b8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:37.906985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc32200d-6a44-48dc-8eff-dd04302d26b8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:37.907521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc32200d-6a44-48dc-8eff-dd04302d26b8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:37.908367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc32200d-6a44-48dc-8eff-dd04302d26b8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:37.908852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bc32200d-6a44-48dc-8eff-dd04302d26b8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:38.032929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bc32200d-6a44-48dc-8eff-dd04302d26b8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:38.042082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bc32200d-6a44-48dc-8eff-dd04302d26b8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148069 Apr 19 03:57:38.042701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 757/1464] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:37 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:39.061068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-aaa6ce02-1d94-4f4b-a47b-a207c6377d7c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:39.061736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-aaa6ce02-1d94-4f4b-a47b-a207c6377d7c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:39.069572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aaa6ce02-1d94-4f4b-a47b-a207c6377d7c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:39.070072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aaa6ce02-1d94-4f4b-a47b-a207c6377d7c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:39.070892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aaa6ce02-1d94-4f4b-a47b-a207c6377d7c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:39.071404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aaa6ce02-1d94-4f4b-a47b-a207c6377d7c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:39.195178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-aaa6ce02-1d94-4f4b-a47b-a207c6377d7c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:39.205038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-aaa6ce02-1d94-4f4b-a47b-a207c6377d7c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148566 Apr 19 03:57:39.205650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 708/1465] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:39 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:57:40.223747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-926edfe5-f40d-4f6b-ab06-90cc35fce51d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:40.224421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-926edfe5-f40d-4f6b-ab06-90cc35fce51d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:40.232271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-926edfe5-f40d-4f6b-ab06-90cc35fce51d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:40.232789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-926edfe5-f40d-4f6b-ab06-90cc35fce51d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:40.233624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-926edfe5-f40d-4f6b-ab06-90cc35fce51d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:40.234117 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-926edfe5-f40d-4f6b-ab06-90cc35fce51d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:40.360064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-926edfe5-f40d-4f6b-ab06-90cc35fce51d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:40.369526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-926edfe5-f40d-4f6b-ab06-90cc35fce51d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149960 Apr 19 03:57:40.370402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 758/1466] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:40 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:41.388004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f7e0d578-591a-4e9b-b605-df2f85cdfd9d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:41.388672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f7e0d578-591a-4e9b-b605-df2f85cdfd9d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:41.396456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7e0d578-591a-4e9b-b605-df2f85cdfd9d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:41.396955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7e0d578-591a-4e9b-b605-df2f85cdfd9d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:41.397774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7e0d578-591a-4e9b-b605-df2f85cdfd9d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:41.398261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f7e0d578-591a-4e9b-b605-df2f85cdfd9d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:41.522339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f7e0d578-591a-4e9b-b605-df2f85cdfd9d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:41.532080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f7e0d578-591a-4e9b-b605-df2f85cdfd9d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148222 Apr 19 03:57:41.532687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 709/1467] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:41 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:42.550783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b99943fe-1868-4f3d-8181-4a4c51ca2614 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:42.551479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b99943fe-1868-4f3d-8181-4a4c51ca2614 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:42.560107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b99943fe-1868-4f3d-8181-4a4c51ca2614 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:42.560609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b99943fe-1868-4f3d-8181-4a4c51ca2614 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:42.561429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b99943fe-1868-4f3d-8181-4a4c51ca2614 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:42.561913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b99943fe-1868-4f3d-8181-4a4c51ca2614 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:42.683506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b99943fe-1868-4f3d-8181-4a4c51ca2614 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:42.693587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b99943fe-1868-4f3d-8181-4a4c51ca2614 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.147019 Apr 19 03:57:42.694210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 759/1468] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:42 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:43.711770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0b521255-9f07-451f-a225-ef04b7b300e1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:43.712441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0b521255-9f07-451f-a225-ef04b7b300e1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:43.720265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b521255-9f07-451f-a225-ef04b7b300e1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:43.720761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b521255-9f07-451f-a225-ef04b7b300e1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:43.721590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b521255-9f07-451f-a225-ef04b7b300e1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:43.722081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0b521255-9f07-451f-a225-ef04b7b300e1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:43.845763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0b521255-9f07-451f-a225-ef04b7b300e1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:43.855287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0b521255-9f07-451f-a225-ef04b7b300e1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.147552 Apr 19 03:57:43.855902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 710/1469] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:43 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:44.873495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9fff1d71-a9cb-473c-a2df-90e26e4b853f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:44.874215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9fff1d71-a9cb-473c-a2df-90e26e4b853f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:44.882051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fff1d71-a9cb-473c-a2df-90e26e4b853f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:44.882555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fff1d71-a9cb-473c-a2df-90e26e4b853f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:44.883406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fff1d71-a9cb-473c-a2df-90e26e4b853f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:44.883891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fff1d71-a9cb-473c-a2df-90e26e4b853f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:45.009540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9fff1d71-a9cb-473c-a2df-90e26e4b853f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:45.019594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9fff1d71-a9cb-473c-a2df-90e26e4b853f tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150435 Apr 19 03:57:45.020215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 760/1470] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:44 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:46.038313 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c1b05ec1-4b72-4399-aa9b-849b2bc8e246 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:46.038985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c1b05ec1-4b72-4399-aa9b-849b2bc8e246 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:46.047404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1b05ec1-4b72-4399-aa9b-849b2bc8e246 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:46.047989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1b05ec1-4b72-4399-aa9b-849b2bc8e246 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:46.048911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1b05ec1-4b72-4399-aa9b-849b2bc8e246 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:46.049468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c1b05ec1-4b72-4399-aa9b-849b2bc8e246 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:46.173556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c1b05ec1-4b72-4399-aa9b-849b2bc8e246 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:46.182739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c1b05ec1-4b72-4399-aa9b-849b2bc8e246 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148546 Apr 19 03:57:46.183366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 711/1471] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:46 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:47.201393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2791019f-dade-46ae-9c19-a9a7a0615636 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:47.202058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2791019f-dade-46ae-9c19-a9a7a0615636 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:47.209892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2791019f-dade-46ae-9c19-a9a7a0615636 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:47.210395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2791019f-dade-46ae-9c19-a9a7a0615636 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:47.211265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2791019f-dade-46ae-9c19-a9a7a0615636 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:47.211753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2791019f-dade-46ae-9c19-a9a7a0615636 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:47.336175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2791019f-dade-46ae-9c19-a9a7a0615636 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:47.345892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2791019f-dade-46ae-9c19-a9a7a0615636 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148612 Apr 19 03:57:47.346507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 761/1472] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:47 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:48.363908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-49a193ee-355e-4716-8fd9-50f483930e85 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:48.364575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-49a193ee-355e-4716-8fd9-50f483930e85 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:48.373127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49a193ee-355e-4716-8fd9-50f483930e85 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:48.373633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49a193ee-355e-4716-8fd9-50f483930e85 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:48.374451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49a193ee-355e-4716-8fd9-50f483930e85 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:48.374934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49a193ee-355e-4716-8fd9-50f483930e85 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:48.503783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-49a193ee-355e-4716-8fd9-50f483930e85 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:48.509270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-49a193ee-355e-4716-8fd9-50f483930e85 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149546 Apr 19 03:57:48.509878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 712/1473] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:48 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:49.527605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-19e3ca78-3239-4242-9c07-cce4c046c1a8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:49.528866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-19e3ca78-3239-4242-9c07-cce4c046c1a8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:49.536709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19e3ca78-3239-4242-9c07-cce4c046c1a8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:49.537214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19e3ca78-3239-4242-9c07-cce4c046c1a8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:49.538042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19e3ca78-3239-4242-9c07-cce4c046c1a8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:49.538532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19e3ca78-3239-4242-9c07-cce4c046c1a8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:49.660606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-19e3ca78-3239-4242-9c07-cce4c046c1a8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:49.669768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-19e3ca78-3239-4242-9c07-cce4c046c1a8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146277 Apr 19 03:57:49.670384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 762/1474] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:49 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:50.687863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e9d7bab8-e026-46ef-9566-192717481519 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:50.688535 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e9d7bab8-e026-46ef-9566-192717481519 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:50.696555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9d7bab8-e026-46ef-9566-192717481519 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:50.697062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9d7bab8-e026-46ef-9566-192717481519 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:50.697889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9d7bab8-e026-46ef-9566-192717481519 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:50.698380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e9d7bab8-e026-46ef-9566-192717481519 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:50.820853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e9d7bab8-e026-46ef-9566-192717481519 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:50.830594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e9d7bab8-e026-46ef-9566-192717481519 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146859 Apr 19 03:57:50.831241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 713/1475] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:50 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:51.849265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b30301b8-9e4a-4855-b871-8cd37fdc912d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:51.849969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b30301b8-9e4a-4855-b871-8cd37fdc912d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:51.858593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b30301b8-9e4a-4855-b871-8cd37fdc912d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:51.859082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b30301b8-9e4a-4855-b871-8cd37fdc912d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:51.859924 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b30301b8-9e4a-4855-b871-8cd37fdc912d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:51.860403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b30301b8-9e4a-4855-b871-8cd37fdc912d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:51.984218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b30301b8-9e4a-4855-b871-8cd37fdc912d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:51.993419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b30301b8-9e4a-4855-b871-8cd37fdc912d tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148282 Apr 19 03:57:51.994035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 763/1476] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:51 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:53.011637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-87574901-8255-4c42-89ab-9db895790bfe tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:53.012310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-87574901-8255-4c42-89ab-9db895790bfe tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:53.020651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87574901-8255-4c42-89ab-9db895790bfe tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:53.021156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87574901-8255-4c42-89ab-9db895790bfe tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:53.021975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87574901-8255-4c42-89ab-9db895790bfe tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:53.022461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87574901-8255-4c42-89ab-9db895790bfe tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:53.146541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-87574901-8255-4c42-89ab-9db895790bfe tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:53.156147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-87574901-8255-4c42-89ab-9db895790bfe tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148602 Apr 19 03:57:53.156765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 714/1477] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:53 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:54.174053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e3380086-dd35-4b76-814c-0ccdbdc93eb4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:54.174713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e3380086-dd35-4b76-814c-0ccdbdc93eb4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:54.182539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3380086-dd35-4b76-814c-0ccdbdc93eb4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:54.183039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3380086-dd35-4b76-814c-0ccdbdc93eb4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:54.183885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3380086-dd35-4b76-814c-0ccdbdc93eb4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:54.184368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3380086-dd35-4b76-814c-0ccdbdc93eb4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:54.310612 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e3380086-dd35-4b76-814c-0ccdbdc93eb4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:54.320006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e3380086-dd35-4b76-814c-0ccdbdc93eb4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150026 Apr 19 03:57:54.320623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 764/1478] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:54 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:55.338890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-54eae5b3-dc55-4d3c-ab19-c858b8aebc00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:55.339605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-54eae5b3-dc55-4d3c-ab19-c858b8aebc00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:55.348088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54eae5b3-dc55-4d3c-ab19-c858b8aebc00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:55.348594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54eae5b3-dc55-4d3c-ab19-c858b8aebc00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:55.349473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54eae5b3-dc55-4d3c-ab19-c858b8aebc00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:55.349968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-54eae5b3-dc55-4d3c-ab19-c858b8aebc00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:55.476919 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-54eae5b3-dc55-4d3c-ab19-c858b8aebc00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:55.487018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-54eae5b3-dc55-4d3c-ab19-c858b8aebc00 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.152423 Apr 19 03:57:55.487894 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 715/1479] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:55 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:56.505242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-72810241-2696-4860-84fa-bc63cd47774c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:56.506088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-72810241-2696-4860-84fa-bc63cd47774c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:56.513998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72810241-2696-4860-84fa-bc63cd47774c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:56.514502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72810241-2696-4860-84fa-bc63cd47774c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:56.515385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72810241-2696-4860-84fa-bc63cd47774c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:56.515918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-72810241-2696-4860-84fa-bc63cd47774c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:56.637668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-72810241-2696-4860-84fa-bc63cd47774c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:56.647007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-72810241-2696-4860-84fa-bc63cd47774c tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.145810 Apr 19 03:57:56.647675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 765/1480] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:56 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:57.664921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0d5e61ab-4129-4521-8439-64fadade3018 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:57.665596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0d5e61ab-4129-4521-8439-64fadade3018 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:57.677822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d5e61ab-4129-4521-8439-64fadade3018 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:57.677822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d5e61ab-4129-4521-8439-64fadade3018 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:57.677822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d5e61ab-4129-4521-8439-64fadade3018 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:57.677822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0d5e61ab-4129-4521-8439-64fadade3018 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:57.798056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0d5e61ab-4129-4521-8439-64fadade3018 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:57.807278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0d5e61ab-4129-4521-8439-64fadade3018 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146574 Apr 19 03:57:57.807893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 716/1481] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:57 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:57:58.826297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6d2d7a2e-07fa-43d8-aa9f-bac00a0766cc tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:57:58.826964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6d2d7a2e-07fa-43d8-aa9f-bac00a0766cc tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:57:58.834790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d2d7a2e-07fa-43d8-aa9f-bac00a0766cc tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:58.835322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d2d7a2e-07fa-43d8-aa9f-bac00a0766cc tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:58.836148 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d2d7a2e-07fa-43d8-aa9f-bac00a0766cc tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:57:58.836630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d2d7a2e-07fa-43d8-aa9f-bac00a0766cc tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:57:59.001341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6d2d7a2e-07fa-43d8-aa9f-bac00a0766cc tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:57:59.010609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6d2d7a2e-07fa-43d8-aa9f-bac00a0766cc tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.188840 Apr 19 03:57:59.011245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 766/1482] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:57:58 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:00.030048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fe69870c-c890-4ca9-ac0a-dea1b5800b19 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:00.030716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fe69870c-c890-4ca9-ac0a-dea1b5800b19 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:00.038533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe69870c-c890-4ca9-ac0a-dea1b5800b19 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:00.039033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe69870c-c890-4ca9-ac0a-dea1b5800b19 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:00.039879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe69870c-c890-4ca9-ac0a-dea1b5800b19 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:00.040364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe69870c-c890-4ca9-ac0a-dea1b5800b19 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:00.164073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fe69870c-c890-4ca9-ac0a-dea1b5800b19 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:00.173252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fe69870c-c890-4ca9-ac0a-dea1b5800b19 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.147870 Apr 19 03:58:00.173909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 717/1483] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:00 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:01.191851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f125dc06-3f02-410a-b12c-4b3855a0047b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:01.192521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f125dc06-3f02-410a-b12c-4b3855a0047b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:01.200945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f125dc06-3f02-410a-b12c-4b3855a0047b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:01.201451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f125dc06-3f02-410a-b12c-4b3855a0047b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:01.202274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f125dc06-3f02-410a-b12c-4b3855a0047b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:01.202763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f125dc06-3f02-410a-b12c-4b3855a0047b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:01.328266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f125dc06-3f02-410a-b12c-4b3855a0047b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:01.338129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f125dc06-3f02-410a-b12c-4b3855a0047b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150369 Apr 19 03:58:01.338747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 767/1484] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:01 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:02.356130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-645a1088-3a49-4bd2-b6cc-f16b9ea18396 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:02.356849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-645a1088-3a49-4bd2-b6cc-f16b9ea18396 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:02.364694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-645a1088-3a49-4bd2-b6cc-f16b9ea18396 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:02.365203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-645a1088-3a49-4bd2-b6cc-f16b9ea18396 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:02.366031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-645a1088-3a49-4bd2-b6cc-f16b9ea18396 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:02.366521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-645a1088-3a49-4bd2-b6cc-f16b9ea18396 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:02.492713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-645a1088-3a49-4bd2-b6cc-f16b9ea18396 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:02.502312 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-645a1088-3a49-4bd2-b6cc-f16b9ea18396 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150292 Apr 19 03:58:02.502926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 718/1485] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:02 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:03.520240 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-89dfabd2-d1f4-480c-bf9d-188b6ffb0f89 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:03.520932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-89dfabd2-d1f4-480c-bf9d-188b6ffb0f89 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:03.528821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89dfabd2-d1f4-480c-bf9d-188b6ffb0f89 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:03.529884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89dfabd2-d1f4-480c-bf9d-188b6ffb0f89 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:03.530720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89dfabd2-d1f4-480c-bf9d-188b6ffb0f89 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:03.531234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89dfabd2-d1f4-480c-bf9d-188b6ffb0f89 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:03.654949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-89dfabd2-d1f4-480c-bf9d-188b6ffb0f89 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:03.664221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-89dfabd2-d1f4-480c-bf9d-188b6ffb0f89 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148086 Apr 19 03:58:03.664828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 768/1486] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:03 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:04.679643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 19 03:58:04.683291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-96a0b953-5331-4436-99d1-ea791112cd95 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:04.683966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-96a0b953-5331-4436-99d1-ea791112cd95 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:04.692523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96a0b953-5331-4436-99d1-ea791112cd95 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:04.693033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96a0b953-5331-4436-99d1-ea791112cd95 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:04.693870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96a0b953-5331-4436-99d1-ea791112cd95 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:04.694363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-96a0b953-5331-4436-99d1-ea791112cd95 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:04.816713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-96a0b953-5331-4436-99d1-ea791112cd95 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:04.825878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-96a0b953-5331-4436-99d1-ea791112cd95 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.147840 Apr 19 03:58:04.826517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 719/1487] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:04 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:05.844065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-be6c3706-7767-42ab-93d5-a8cbd785cbc8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:05.844695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-be6c3706-7767-42ab-93d5-a8cbd785cbc8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:05.852473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be6c3706-7767-42ab-93d5-a8cbd785cbc8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:05.852975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be6c3706-7767-42ab-93d5-a8cbd785cbc8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:05.853794 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be6c3706-7767-42ab-93d5-a8cbd785cbc8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:05.854279 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-be6c3706-7767-42ab-93d5-a8cbd785cbc8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:06.087807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-be6c3706-7767-42ab-93d5-a8cbd785cbc8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:06.097263 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-be6c3706-7767-42ab-93d5-a8cbd785cbc8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.257348 Apr 19 03:58:06.097828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 769/1488] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:05 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:07.115120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9aa8406c-65f5-407b-a462-9affd7171bd3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:07.115794 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9aa8406c-65f5-407b-a462-9affd7171bd3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:07.129943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:58:07.131250 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:58:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e (ip 10.222.0.25) !!! Apr 19 03:58:07.145868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9aa8406c-65f5-407b-a462-9affd7171bd3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:07.146530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9aa8406c-65f5-407b-a462-9affd7171bd3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:07.147896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9aa8406c-65f5-407b-a462-9affd7171bd3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:07.148993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9aa8406c-65f5-407b-a462-9affd7171bd3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:07.156181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42568. Apr 19 03:58:07.339231 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9aa8406c-65f5-407b-a462-9affd7171bd3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:07.348633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9aa8406c-65f5-407b-a462-9affd7171bd3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.237651 Apr 19 03:58:07.349253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 720/1489] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:07 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:08.367019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d0614a55-740b-43e7-88c0-1b181876c703 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:08.367715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d0614a55-740b-43e7-88c0-1b181876c703 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:08.375889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0614a55-740b-43e7-88c0-1b181876c703 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:08.376398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0614a55-740b-43e7-88c0-1b181876c703 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:08.377224 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0614a55-740b-43e7-88c0-1b181876c703 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:08.377716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0614a55-740b-43e7-88c0-1b181876c703 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:08.502953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d0614a55-740b-43e7-88c0-1b181876c703 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:08.512519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d0614a55-740b-43e7-88c0-1b181876c703 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149611 Apr 19 03:58:08.518304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 770/1490] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:08 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:09.534628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-062489bc-e8b5-45d6-8350-797a7526cfc7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:09.535321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-062489bc-e8b5-45d6-8350-797a7526cfc7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:09.543119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-062489bc-e8b5-45d6-8350-797a7526cfc7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:09.543650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-062489bc-e8b5-45d6-8350-797a7526cfc7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:09.544479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-062489bc-e8b5-45d6-8350-797a7526cfc7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:09.545543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-062489bc-e8b5-45d6-8350-797a7526cfc7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:09.848925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-062489bc-e8b5-45d6-8350-797a7526cfc7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:09.848925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-062489bc-e8b5-45d6-8350-797a7526cfc7 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.151539 Apr 19 03:58:09.848925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 721/1491] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:09 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:10.700065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-87026c02-c821-463f-8cad-db9d007d3ec0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:10.700738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-87026c02-c821-463f-8cad-db9d007d3ec0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:10.708454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87026c02-c821-463f-8cad-db9d007d3ec0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:10.708953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87026c02-c821-463f-8cad-db9d007d3ec0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:10.709769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87026c02-c821-463f-8cad-db9d007d3ec0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:10.710254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-87026c02-c821-463f-8cad-db9d007d3ec0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:10.833115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-87026c02-c821-463f-8cad-db9d007d3ec0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:10.842443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-87026c02-c821-463f-8cad-db9d007d3ec0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146599 Apr 19 03:58:10.843102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 771/1492] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:10 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:11.860431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-68ea4ec9-b37d-4cbc-bb31-9125584b33d2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:11.861048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-68ea4ec9-b37d-4cbc-bb31-9125584b33d2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:11.868963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68ea4ec9-b37d-4cbc-bb31-9125584b33d2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:11.869469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68ea4ec9-b37d-4cbc-bb31-9125584b33d2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:11.870558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68ea4ec9-b37d-4cbc-bb31-9125584b33d2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:11.871049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-68ea4ec9-b37d-4cbc-bb31-9125584b33d2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:11.992862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-68ea4ec9-b37d-4cbc-bb31-9125584b33d2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:12.002861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-68ea4ec9-b37d-4cbc-bb31-9125584b33d2 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146684 Apr 19 03:58:12.003529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 722/1493] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:11 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:13.020352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8314aa96-dc4c-42ed-9a7f-65833fa312b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:13.021020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8314aa96-dc4c-42ed-9a7f-65833fa312b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:13.028765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8314aa96-dc4c-42ed-9a7f-65833fa312b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:13.029912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8314aa96-dc4c-42ed-9a7f-65833fa312b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:13.030746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8314aa96-dc4c-42ed-9a7f-65833fa312b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:13.031251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8314aa96-dc4c-42ed-9a7f-65833fa312b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:13.155551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8314aa96-dc4c-42ed-9a7f-65833fa312b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:13.164724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8314aa96-dc4c-42ed-9a7f-65833fa312b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148388 Apr 19 03:58:13.165334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 772/1494] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:13 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:14.181993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8597af8a-5e16-4d7d-b777-f578e396dd5b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:14.182667 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8597af8a-5e16-4d7d-b777-f578e396dd5b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:14.190478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8597af8a-5e16-4d7d-b777-f578e396dd5b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:14.190987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8597af8a-5e16-4d7d-b777-f578e396dd5b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:14.191851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8597af8a-5e16-4d7d-b777-f578e396dd5b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:14.192353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8597af8a-5e16-4d7d-b777-f578e396dd5b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:14.318076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8597af8a-5e16-4d7d-b777-f578e396dd5b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:14.328049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8597af8a-5e16-4d7d-b777-f578e396dd5b tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150120 Apr 19 03:58:14.328666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 723/1495] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:14 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:15.346170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a56d6e61-aa14-4cee-b660-c40ca24f46f8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:15.346834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a56d6e61-aa14-4cee-b660-c40ca24f46f8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:15.354725 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a56d6e61-aa14-4cee-b660-c40ca24f46f8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:15.355274 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a56d6e61-aa14-4cee-b660-c40ca24f46f8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:15.356100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a56d6e61-aa14-4cee-b660-c40ca24f46f8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:15.356590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a56d6e61-aa14-4cee-b660-c40ca24f46f8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:15.481477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a56d6e61-aa14-4cee-b660-c40ca24f46f8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:15.491469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a56d6e61-aa14-4cee-b660-c40ca24f46f8 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149390 Apr 19 03:58:15.492080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 773/1496] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:15 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:16.509370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4db39963-2a3e-4054-80df-6b2538c884ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:16.509978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4db39963-2a3e-4054-80df-6b2538c884ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:16.518461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4db39963-2a3e-4054-80df-6b2538c884ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:16.518981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4db39963-2a3e-4054-80df-6b2538c884ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:16.519832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4db39963-2a3e-4054-80df-6b2538c884ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:16.520319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4db39963-2a3e-4054-80df-6b2538c884ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:16.646751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4db39963-2a3e-4054-80df-6b2538c884ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:16.656153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4db39963-2a3e-4054-80df-6b2538c884ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150911 Apr 19 03:58:16.656772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 724/1497] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:16 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:17.674065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d23e6cdc-f121-4833-949b-93efb7b008bb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:17.674734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d23e6cdc-f121-4833-949b-93efb7b008bb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:17.682448 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d23e6cdc-f121-4833-949b-93efb7b008bb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:17.682953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d23e6cdc-f121-4833-949b-93efb7b008bb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:17.683949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d23e6cdc-f121-4833-949b-93efb7b008bb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:17.684440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d23e6cdc-f121-4833-949b-93efb7b008bb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:17.807643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d23e6cdc-f121-4833-949b-93efb7b008bb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:17.817568 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d23e6cdc-f121-4833-949b-93efb7b008bb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.147589 Apr 19 03:58:17.818175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 774/1498] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:17 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:18.836368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0daa94e6-29d0-402e-b851-e16de89257b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:18.837046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0daa94e6-29d0-402e-b851-e16de89257b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:18.846756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0daa94e6-29d0-402e-b851-e16de89257b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:18.847299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0daa94e6-29d0-402e-b851-e16de89257b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:18.848157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0daa94e6-29d0-402e-b851-e16de89257b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:18.848655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0daa94e6-29d0-402e-b851-e16de89257b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:18.974078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0daa94e6-29d0-402e-b851-e16de89257b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:18.983398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0daa94e6-29d0-402e-b851-e16de89257b0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.151034 Apr 19 03:58:18.987062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 725/1499] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:18 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:20.002324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a4118e58-febe-45ff-93fe-88d8c127b781 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:20.003050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a4118e58-febe-45ff-93fe-88d8c127b781 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:20.006732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 19 03:58:20.012272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4118e58-febe-45ff-93fe-88d8c127b781 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:20.012793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4118e58-febe-45ff-93fe-88d8c127b781 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:20.013648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4118e58-febe-45ff-93fe-88d8c127b781 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:20.014167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4118e58-febe-45ff-93fe-88d8c127b781 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:20.138472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a4118e58-febe-45ff-93fe-88d8c127b781 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:20.147713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a4118e58-febe-45ff-93fe-88d8c127b781 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149462 Apr 19 03:58:20.148325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 775/1500] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:19 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:21.297779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-52aca1db-9815-4cf2-b6a0-f489b1d7b84e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:21.298488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-52aca1db-9815-4cf2-b6a0-f489b1d7b84e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:21.306511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52aca1db-9815-4cf2-b6a0-f489b1d7b84e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:21.307020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52aca1db-9815-4cf2-b6a0-f489b1d7b84e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:21.307882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52aca1db-9815-4cf2-b6a0-f489b1d7b84e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:21.308377 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52aca1db-9815-4cf2-b6a0-f489b1d7b84e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:21.434776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-52aca1db-9815-4cf2-b6a0-f489b1d7b84e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:21.444165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-52aca1db-9815-4cf2-b6a0-f489b1d7b84e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.282227 Apr 19 03:58:21.444792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 726/1501] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:21 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:22.462673 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-921da57d-4155-4c47-98c1-5981daeda1c4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:22.463379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-921da57d-4155-4c47-98c1-5981daeda1c4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:22.482464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-921da57d-4155-4c47-98c1-5981daeda1c4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:22.482968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-921da57d-4155-4c47-98c1-5981daeda1c4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:22.483935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-921da57d-4155-4c47-98c1-5981daeda1c4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:22.484427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-921da57d-4155-4c47-98c1-5981daeda1c4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:22.539422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42658. Apr 19 03:58:22.614022 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-921da57d-4155-4c47-98c1-5981daeda1c4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:22.624347 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-921da57d-4155-4c47-98c1-5981daeda1c4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.165781 Apr 19 03:58:22.624909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 776/1502] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:22 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:23.211083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:58:23.211275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:58:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:58:23.642858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5e0b67e6-f06b-44db-a72e-8769848507c0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:23.643553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5e0b67e6-f06b-44db-a72e-8769848507c0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:23.651305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e0b67e6-f06b-44db-a72e-8769848507c0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:23.651808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e0b67e6-f06b-44db-a72e-8769848507c0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:23.652627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e0b67e6-f06b-44db-a72e-8769848507c0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:23.653113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e0b67e6-f06b-44db-a72e-8769848507c0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:23.779025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5e0b67e6-f06b-44db-a72e-8769848507c0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:23.788369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5e0b67e6-f06b-44db-a72e-8769848507c0 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150235 Apr 19 03:58:23.788991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 727/1503] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:23 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:24.806269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4259c657-6a48-43fa-841d-796ad165c820 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:24.806935 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4259c657-6a48-43fa-841d-796ad165c820 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:24.814779 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4259c657-6a48-43fa-841d-796ad165c820 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:24.815322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4259c657-6a48-43fa-841d-796ad165c820 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:24.816155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4259c657-6a48-43fa-841d-796ad165c820 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:24.816646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4259c657-6a48-43fa-841d-796ad165c820 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:24.938683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4259c657-6a48-43fa-841d-796ad165c820 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:24.947889 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4259c657-6a48-43fa-841d-796ad165c820 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.145730 Apr 19 03:58:24.948503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 777/1504] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:24 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:25.967600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fea21a86-1f8f-4613-acb6-dc4df8985df6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:25.968265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fea21a86-1f8f-4613-acb6-dc4df8985df6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:25.976370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fea21a86-1f8f-4613-acb6-dc4df8985df6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:25.976869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fea21a86-1f8f-4613-acb6-dc4df8985df6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:25.977884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fea21a86-1f8f-4613-acb6-dc4df8985df6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:25.978372 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fea21a86-1f8f-4613-acb6-dc4df8985df6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:26.102470 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fea21a86-1f8f-4613-acb6-dc4df8985df6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:26.112444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fea21a86-1f8f-4613-acb6-dc4df8985df6 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149763 Apr 19 03:58:26.113073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 728/1505] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:25 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:27.130728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0f7f8e63-906b-4215-9d38-a30cf94bf0bd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:27.131385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0f7f8e63-906b-4215-9d38-a30cf94bf0bd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:27.139186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f7f8e63-906b-4215-9d38-a30cf94bf0bd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:27.139711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f7f8e63-906b-4215-9d38-a30cf94bf0bd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:27.140539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f7f8e63-906b-4215-9d38-a30cf94bf0bd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:27.141034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f7f8e63-906b-4215-9d38-a30cf94bf0bd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:27.265780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0f7f8e63-906b-4215-9d38-a30cf94bf0bd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:27.275018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0f7f8e63-906b-4215-9d38-a30cf94bf0bd tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148425 Apr 19 03:58:27.275679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 778/1506] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:27 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:28.293256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c112fce9-5013-4b0b-8665-83f70a8db1c1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:28.294581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c112fce9-5013-4b0b-8665-83f70a8db1c1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:28.302428 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c112fce9-5013-4b0b-8665-83f70a8db1c1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:28.302933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c112fce9-5013-4b0b-8665-83f70a8db1c1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:28.303789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c112fce9-5013-4b0b-8665-83f70a8db1c1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:28.304283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c112fce9-5013-4b0b-8665-83f70a8db1c1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:28.429413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c112fce9-5013-4b0b-8665-83f70a8db1c1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:28.438679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c112fce9-5013-4b0b-8665-83f70a8db1c1 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149626 Apr 19 03:58:28.439313 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 729/1507] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:28 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:29.456755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-758ca40a-0e56-45e8-9e4c-2f5ed3512742 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:29.457419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-758ca40a-0e56-45e8-9e4c-2f5ed3512742 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:29.465226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-758ca40a-0e56-45e8-9e4c-2f5ed3512742 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:29.465726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-758ca40a-0e56-45e8-9e4c-2f5ed3512742 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:29.466548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-758ca40a-0e56-45e8-9e4c-2f5ed3512742 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:29.467032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-758ca40a-0e56-45e8-9e4c-2f5ed3512742 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:29.592447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-758ca40a-0e56-45e8-9e4c-2f5ed3512742 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:29.602046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-758ca40a-0e56-45e8-9e4c-2f5ed3512742 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149376 Apr 19 03:58:29.602648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 779/1508] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:29 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:30.620784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6d2a6bf2-1c6e-45b7-ab99-f641b9a1c96e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:30.621443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6d2a6bf2-1c6e-45b7-ab99-f641b9a1c96e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:30.629911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d2a6bf2-1c6e-45b7-ab99-f641b9a1c96e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:30.630412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d2a6bf2-1c6e-45b7-ab99-f641b9a1c96e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:30.631258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d2a6bf2-1c6e-45b7-ab99-f641b9a1c96e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:30.631745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6d2a6bf2-1c6e-45b7-ab99-f641b9a1c96e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:30.757111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6d2a6bf2-1c6e-45b7-ab99-f641b9a1c96e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:30.767260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6d2a6bf2-1c6e-45b7-ab99-f641b9a1c96e tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150759 Apr 19 03:58:30.767885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 730/1509] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:30 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:31.785944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ba180eef-000f-4f65-be1e-1ace8c374353 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:31.786619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ba180eef-000f-4f65-be1e-1ace8c374353 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:31.794497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba180eef-000f-4f65-be1e-1ace8c374353 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:31.795005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba180eef-000f-4f65-be1e-1ace8c374353 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:31.795880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba180eef-000f-4f65-be1e-1ace8c374353 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:31.796369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ba180eef-000f-4f65-be1e-1ace8c374353 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:31.917890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ba180eef-000f-4f65-be1e-1ace8c374353 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:31.927110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ba180eef-000f-4f65-be1e-1ace8c374353 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.145378 Apr 19 03:58:31.927758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 780/1510] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:31 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:32.946026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a0f18760-bb2a-4758-870e-1d1e7733d4af tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:32.946694 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a0f18760-bb2a-4758-870e-1d1e7733d4af tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:32.954745 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a0f18760-bb2a-4758-870e-1d1e7733d4af tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:32.955279 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a0f18760-bb2a-4758-870e-1d1e7733d4af tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:32.956112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a0f18760-bb2a-4758-870e-1d1e7733d4af tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:32.956594 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a0f18760-bb2a-4758-870e-1d1e7733d4af tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:33.080155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a0f18760-bb2a-4758-870e-1d1e7733d4af tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:33.089574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a0f18760-bb2a-4758-870e-1d1e7733d4af tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.147656 Apr 19 03:58:33.090182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 731/1511] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:32 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:34.107799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ccdd3afc-e686-4c4b-94b6-cc65cfb684ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:34.108473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ccdd3afc-e686-4c4b-94b6-cc65cfb684ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:34.116388 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ccdd3afc-e686-4c4b-94b6-cc65cfb684ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:34.116898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ccdd3afc-e686-4c4b-94b6-cc65cfb684ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:34.117728 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ccdd3afc-e686-4c4b-94b6-cc65cfb684ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:34.118219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ccdd3afc-e686-4c4b-94b6-cc65cfb684ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:34.244195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ccdd3afc-e686-4c4b-94b6-cc65cfb684ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:34.254411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ccdd3afc-e686-4c4b-94b6-cc65cfb684ec tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150825 Apr 19 03:58:34.255014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 781/1512] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:34 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:35.273293 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-84a75927-f3a9-4954-818b-fd42abb61882 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:35.273966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-84a75927-f3a9-4954-818b-fd42abb61882 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:35.282507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84a75927-f3a9-4954-818b-fd42abb61882 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:35.283004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84a75927-f3a9-4954-818b-fd42abb61882 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:35.283862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84a75927-f3a9-4954-818b-fd42abb61882 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:35.284341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84a75927-f3a9-4954-818b-fd42abb61882 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:35.411053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-84a75927-f3a9-4954-818b-fd42abb61882 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:35.420814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-84a75927-f3a9-4954-818b-fd42abb61882 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.151603 Apr 19 03:58:35.421441 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 732/1513] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:35 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:36.439447 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-57fe526d-17aa-4ce0-a602-28f674822d66 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:36.440690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-57fe526d-17aa-4ce0-a602-28f674822d66 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:36.448455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57fe526d-17aa-4ce0-a602-28f674822d66 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:36.448954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57fe526d-17aa-4ce0-a602-28f674822d66 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:36.449775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57fe526d-17aa-4ce0-a602-28f674822d66 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:36.450236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-57fe526d-17aa-4ce0-a602-28f674822d66 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:36.576545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-57fe526d-17aa-4ce0-a602-28f674822d66 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:36.586081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-57fe526d-17aa-4ce0-a602-28f674822d66 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150793 Apr 19 03:58:36.586708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 782/1514] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:36 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:37.604516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-99012f69-0547-401e-8ee9-be8a6c83a880 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:37.605212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-99012f69-0547-401e-8ee9-be8a6c83a880 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:37.613543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99012f69-0547-401e-8ee9-be8a6c83a880 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:37.614046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99012f69-0547-401e-8ee9-be8a6c83a880 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:37.614878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99012f69-0547-401e-8ee9-be8a6c83a880 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:37.615407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99012f69-0547-401e-8ee9-be8a6c83a880 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:37.748967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-99012f69-0547-401e-8ee9-be8a6c83a880 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:37.759056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-99012f69-0547-401e-8ee9-be8a6c83a880 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.158381 Apr 19 03:58:37.759756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 733/1515] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:37 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:38.777976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-368f2d9d-803b-45f1-93c3-a2a75c201121 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:38.778644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-368f2d9d-803b-45f1-93c3-a2a75c201121 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:38.786374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-368f2d9d-803b-45f1-93c3-a2a75c201121 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:38.786875 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-368f2d9d-803b-45f1-93c3-a2a75c201121 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:38.787721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-368f2d9d-803b-45f1-93c3-a2a75c201121 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:38.788205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-368f2d9d-803b-45f1-93c3-a2a75c201121 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:38.914389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-368f2d9d-803b-45f1-93c3-a2a75c201121 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:38.923789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-368f2d9d-803b-45f1-93c3-a2a75c201121 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149977 Apr 19 03:58:38.924402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 783/1516] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:38 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:39.941780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b44d389a-7ea8-4180-8771-6403ee3fe3ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:39.942489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b44d389a-7ea8-4180-8771-6403ee3fe3ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:39.950825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b44d389a-7ea8-4180-8771-6403ee3fe3ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:39.951362 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b44d389a-7ea8-4180-8771-6403ee3fe3ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:39.952194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b44d389a-7ea8-4180-8771-6403ee3fe3ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:39.952683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b44d389a-7ea8-4180-8771-6403ee3fe3ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:40.075337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b44d389a-7ea8-4180-8771-6403ee3fe3ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:40.084628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b44d389a-7ea8-4180-8771-6403ee3fe3ee tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.147004 Apr 19 03:58:40.085244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 734/1517] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:39 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:41.103325 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f5866092-2264-4ffa-8633-b10517ea73ea tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:41.103990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f5866092-2264-4ffa-8633-b10517ea73ea tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:41.112395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5866092-2264-4ffa-8633-b10517ea73ea tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:41.112844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5866092-2264-4ffa-8633-b10517ea73ea tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:41.113659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5866092-2264-4ffa-8633-b10517ea73ea tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:41.114143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5866092-2264-4ffa-8633-b10517ea73ea tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:41.238314 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f5866092-2264-4ffa-8633-b10517ea73ea tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:41.247839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f5866092-2264-4ffa-8633-b10517ea73ea tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148642 Apr 19 03:58:41.248445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 784/1518] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:41 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:58:42.266006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2768efee-1454-4ff6-8d2f-18ebf0a9baf4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:42.266703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2768efee-1454-4ff6-8d2f-18ebf0a9baf4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:42.274513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2768efee-1454-4ff6-8d2f-18ebf0a9baf4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:42.275020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2768efee-1454-4ff6-8d2f-18ebf0a9baf4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:42.275907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2768efee-1454-4ff6-8d2f-18ebf0a9baf4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:42.276404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2768efee-1454-4ff6-8d2f-18ebf0a9baf4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:42.401835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2768efee-1454-4ff6-8d2f-18ebf0a9baf4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:42.411750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2768efee-1454-4ff6-8d2f-18ebf0a9baf4 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149948 Apr 19 03:58:42.412364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 735/1519] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:42 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:43.430389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0c52e61e-5a31-4574-a01f-e9fe5b32686a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:43.430997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0c52e61e-5a31-4574-a01f-e9fe5b32686a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:43.439285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c52e61e-5a31-4574-a01f-e9fe5b32686a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:43.439785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c52e61e-5a31-4574-a01f-e9fe5b32686a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:43.440605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c52e61e-5a31-4574-a01f-e9fe5b32686a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:43.441091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c52e61e-5a31-4574-a01f-e9fe5b32686a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:43.564007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0c52e61e-5a31-4574-a01f-e9fe5b32686a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:43.573758 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0c52e61e-5a31-4574-a01f-e9fe5b32686a tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.147439 Apr 19 03:58:43.574384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 785/1520] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:43 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:44.592980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1f63e5ca-dd62-4ad3-917a-55f691dbcc09 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:44.593449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1f63e5ca-dd62-4ad3-917a-55f691dbcc09 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:44.601355 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f63e5ca-dd62-4ad3-917a-55f691dbcc09 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:44.601865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f63e5ca-dd62-4ad3-917a-55f691dbcc09 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:44.602696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f63e5ca-dd62-4ad3-917a-55f691dbcc09 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:44.603206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1f63e5ca-dd62-4ad3-917a-55f691dbcc09 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:44.728202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1f63e5ca-dd62-4ad3-917a-55f691dbcc09 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:44.737680 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1f63e5ca-dd62-4ad3-917a-55f691dbcc09 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149693 Apr 19 03:58:44.738287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 736/1521] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:44 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:45.756502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bda9b6c7-f80f-4a24-8276-e67b6b9110df tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:45.757173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bda9b6c7-f80f-4a24-8276-e67b6b9110df tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:45.765655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bda9b6c7-f80f-4a24-8276-e67b6b9110df tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:45.766165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bda9b6c7-f80f-4a24-8276-e67b6b9110df tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:45.766985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bda9b6c7-f80f-4a24-8276-e67b6b9110df tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:45.767506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bda9b6c7-f80f-4a24-8276-e67b6b9110df tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:45.892210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bda9b6c7-f80f-4a24-8276-e67b6b9110df tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:45.901530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bda9b6c7-f80f-4a24-8276-e67b6b9110df tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.149132 Apr 19 03:58:45.902146 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 786/1522] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:45 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:46.920995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0a486ffe-5b9b-476e-b5b1-4300aafd5b98 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:46.921698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0a486ffe-5b9b-476e-b5b1-4300aafd5b98 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:46.929648 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a486ffe-5b9b-476e-b5b1-4300aafd5b98 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:46.930153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a486ffe-5b9b-476e-b5b1-4300aafd5b98 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:46.930983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a486ffe-5b9b-476e-b5b1-4300aafd5b98 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:46.931500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a486ffe-5b9b-476e-b5b1-4300aafd5b98 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:47.053307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0a486ffe-5b9b-476e-b5b1-4300aafd5b98 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:47.062582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0a486ffe-5b9b-476e-b5b1-4300aafd5b98 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.146427 Apr 19 03:58:47.063216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 737/1523] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:46 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:48.080807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c7c0b070-0041-414a-8893-3b39e76b1ce3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:48.081479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c7c0b070-0041-414a-8893-3b39e76b1ce3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:48.089352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c7c0b070-0041-414a-8893-3b39e76b1ce3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:48.089855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c7c0b070-0041-414a-8893-3b39e76b1ce3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:48.090685 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c7c0b070-0041-414a-8893-3b39e76b1ce3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:48.091195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c7c0b070-0041-414a-8893-3b39e76b1ce3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:48.215888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c7c0b070-0041-414a-8893-3b39e76b1ce3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:48.225195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c7c0b070-0041-414a-8893-3b39e76b1ce3 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.148645 Apr 19 03:58:48.225807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 787/1524] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:48 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 03:58:49.243074 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9d61d11e-e30b-41fd-948f-a66300d72cbb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:49.243782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9d61d11e-e30b-41fd-948f-a66300d72cbb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:49.252337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d61d11e-e30b-41fd-948f-a66300d72cbb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:49.252846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d61d11e-e30b-41fd-948f-a66300d72cbb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:49.253681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d61d11e-e30b-41fd-948f-a66300d72cbb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:49.254169 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9d61d11e-e30b-41fd-948f-a66300d72cbb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:49.379591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9d61d11e-e30b-41fd-948f-a66300d72cbb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:49.389653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9d61d11e-e30b-41fd-948f-a66300d72cbb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.150654 Apr 19 03:58:49.390257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 738/1525] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:49 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:50.408759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-113d09a4-18db-47d1-b837-8ed6ac6a7f60 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:50.409425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-113d09a4-18db-47d1-b837-8ed6ac6a7f60 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:50.417188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-113d09a4-18db-47d1-b837-8ed6ac6a7f60 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:50.417688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-113d09a4-18db-47d1-b837-8ed6ac6a7f60 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:50.418506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-113d09a4-18db-47d1-b837-8ed6ac6a7f60 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:50.418991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-113d09a4-18db-47d1-b837-8ed6ac6a7f60 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:50.540480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-113d09a4-18db-47d1-b837-8ed6ac6a7f60 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:50.549908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-113d09a4-18db-47d1-b837-8ed6ac6a7f60 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.145234 Apr 19 03:58:50.550533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 788/1526] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:50 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:51.567057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8b97114d-5347-4dce-a65d-348ea62da2cb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:51.567765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8b97114d-5347-4dce-a65d-348ea62da2cb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:51.580103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b97114d-5347-4dce-a65d-348ea62da2cb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:51.580103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b97114d-5347-4dce-a65d-348ea62da2cb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:51.580103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b97114d-5347-4dce-a65d-348ea62da2cb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:51.580103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8b97114d-5347-4dce-a65d-348ea62da2cb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:51.704330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8b97114d-5347-4dce-a65d-348ea62da2cb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c52bd46007e4ac6b6d4091a798424c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bc321f6ebe4f21af7ed85906e23ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:58:51.714085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8b97114d-5347-4dce-a65d-348ea62da2cb tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 200 len: 1350 microversion: 2.1 time: 0.151131 Apr 19 03:58:51.714706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 739/1527] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:51 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:58:52.732702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d25d1d29-af92-431d-990b-0aed2511e085 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:58:52.733368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d25d1d29-af92-431d-990b-0aed2511e085 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] [instance: 399e1abb-7255-4f6f-b038-2fbfe20f7b3e] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:58:52.741210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d25d1d29-af92-431d-990b-0aed2511e085 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:52.741705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d25d1d29-af92-431d-990b-0aed2511e085 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:52.742521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d25d1d29-af92-431d-990b-0aed2511e085 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:58:52.743008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d25d1d29-af92-431d-990b-0aed2511e085 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:58:52.795244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-d25d1d29-af92-431d-990b-0aed2511e085 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] HTTP exception thrown: Instance 399e1abb-7255-4f6f-b038-2fbfe20f7b3e could not be found. Apr 19 03:58:52.795890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d25d1d29-af92-431d-990b-0aed2511e085 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] Returning 404 to user: Instance 399e1abb-7255-4f6f-b038-2fbfe20f7b3e could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 03:58:52.796769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d25d1d29-af92-431d-990b-0aed2511e085 tempest-VolumesSnapshotTestJSON-1222185449 tempest-VolumesSnapshotTestJSON-1222185449-project] 10.222.0.25 "GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e" status: 404 len: 111 microversion: 2.1 time: 0.068786 Apr 19 03:58:52.797344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 789/1528] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:58:52 2021] GET /compute/v2.1/servers/399e1abb-7255-4f6f-b038-2fbfe20f7b3e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 03:59:41.551050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f943cf77-3353-4818-bfed-c8f40c0d6a3e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:41.552226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f943cf77-3353-4818-bfed-c8f40c0d6a3e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:41.561116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f943cf77-3353-4818-bfed-c8f40c0d6a3e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:41.561806 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f943cf77-3353-4818-bfed-c8f40c0d6a3e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:41.562967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f943cf77-3353-4818-bfed-c8f40c0d6a3e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:41.563514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f943cf77-3353-4818-bfed-c8f40c0d6a3e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:41.629296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f943cf77-3353-4818-bfed-c8f40c0d6a3e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 03:59:41.948682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f943cf77-3353-4818-bfed-c8f40c0d6a3e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 204 len: 0 microversion: 2.1 time: 0.401659 Apr 19 03:59:41.949335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 740/1529] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 03:59:41 2021] DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 03:59:41.958647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ca3727cc-b026-453d-a687-e0a6b6800f58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:41.959367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ca3727cc-b026-453d-a687-e0a6b6800f58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:41.967184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca3727cc-b026-453d-a687-e0a6b6800f58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:41.967718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca3727cc-b026-453d-a687-e0a6b6800f58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:41.968555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca3727cc-b026-453d-a687-e0a6b6800f58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:41.969031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ca3727cc-b026-453d-a687-e0a6b6800f58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:42.180460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ca3727cc-b026-453d-a687-e0a6b6800f58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:42.190884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ca3727cc-b026-453d-a687-e0a6b6800f58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1768 microversion: 2.1 time: 0.236426 Apr 19 03:59:42.191517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 790/1530] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:41 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1768 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:43.210769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-76a95c20-a4bd-40a8-b364-c2e050580ffa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:43.211675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-76a95c20-a4bd-40a8-b364-c2e050580ffa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:43.219615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76a95c20-a4bd-40a8-b364-c2e050580ffa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:43.220124 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76a95c20-a4bd-40a8-b364-c2e050580ffa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:43.220957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76a95c20-a4bd-40a8-b364-c2e050580ffa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:43.221453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-76a95c20-a4bd-40a8-b364-c2e050580ffa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:43.436391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-76a95c20-a4bd-40a8-b364-c2e050580ffa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:43.446995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-76a95c20-a4bd-40a8-b364-c2e050580ffa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1768 microversion: 2.1 time: 0.240793 Apr 19 03:59:43.447927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 741/1531] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:43 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1768 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:44.466529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fdb8cbc1-402e-429e-885b-06604df95ba5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:44.467343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fdb8cbc1-402e-429e-885b-06604df95ba5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:44.476385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fdb8cbc1-402e-429e-885b-06604df95ba5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:44.476912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fdb8cbc1-402e-429e-885b-06604df95ba5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:44.477975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fdb8cbc1-402e-429e-885b-06604df95ba5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:44.478469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fdb8cbc1-402e-429e-885b-06604df95ba5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:44.494838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-7b0b232c-325c-4e10-b5b8-d8ebe314c419 req-25962bb1-80bd-4df8-90b8-5afcf4c0a5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0656c7c5-439a-47a8-ab73-8a5e4e007bbd", "name": "network-vif-deleted", "tag": "f83c1559-bd4d-464d-a64e-211ac4f14239"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 03:59:44.497042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 03:59:44.497042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 03:59:44.506299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-7b0b232c-325c-4e10-b5b8-d8ebe314c419 req-25962bb1-80bd-4df8-90b8-5afcf4c0a5b3 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:44.507112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-7b0b232c-325c-4e10-b5b8-d8ebe314c419 req-25962bb1-80bd-4df8-90b8-5afcf4c0a5b3 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:44.526087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-7b0b232c-325c-4e10-b5b8-d8ebe314c419 req-25962bb1-80bd-4df8-90b8-5afcf4c0a5b3 service nova] Creating event network-vif-deleted:f83c1559-bd4d-464d-a64e-211ac4f14239 for instance 0656c7c5-439a-47a8-ab73-8a5e4e007bbd on hv-cinder-78605 Apr 19 03:59:44.532675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-7b0b232c-325c-4e10-b5b8-d8ebe314c419 req-25962bb1-80bd-4df8-90b8-5afcf4c0a5b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049763 Apr 19 03:59:44.534171 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 742/1532] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 03:59:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 03:59:44.683827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fdb8cbc1-402e-429e-885b-06604df95ba5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:44.694477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fdb8cbc1-402e-429e-885b-06604df95ba5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1700 microversion: 2.1 time: 0.232651 Apr 19 03:59:44.695135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 791/1533] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:44 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1700 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:45.714255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-05a1196c-93cf-4316-94af-e1642b5729f1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:45.715012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-05a1196c-93cf-4316-94af-e1642b5729f1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:45.723666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05a1196c-93cf-4316-94af-e1642b5729f1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:45.724172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05a1196c-93cf-4316-94af-e1642b5729f1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:45.725001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05a1196c-93cf-4316-94af-e1642b5729f1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:45.725491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-05a1196c-93cf-4316-94af-e1642b5729f1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:45.854212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-05a1196c-93cf-4316-94af-e1642b5729f1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:45.864302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-05a1196c-93cf-4316-94af-e1642b5729f1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.154757 Apr 19 03:59:45.864907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 743/1534] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:45 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:46.820799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:59:46.821294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:59:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:59:46.882258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-19ee44bf-8a3c-434c-ba8c-75325b7ebcf6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:46.882877 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-19ee44bf-8a3c-434c-ba8c-75325b7ebcf6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:46.890890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19ee44bf-8a3c-434c-ba8c-75325b7ebcf6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:46.891446 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19ee44bf-8a3c-434c-ba8c-75325b7ebcf6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:46.892281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19ee44bf-8a3c-434c-ba8c-75325b7ebcf6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:46.892773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19ee44bf-8a3c-434c-ba8c-75325b7ebcf6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:47.015303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-19ee44bf-8a3c-434c-ba8c-75325b7ebcf6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:47.025193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-19ee44bf-8a3c-434c-ba8c-75325b7ebcf6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147042 Apr 19 03:59:47.025805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 792/1535] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:46 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:48.043693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d6d0ed35-4365-4df9-abc1-2d23ce77edaa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:48.044855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d6d0ed35-4365-4df9-abc1-2d23ce77edaa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:48.052613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6d0ed35-4365-4df9-abc1-2d23ce77edaa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:48.053116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6d0ed35-4365-4df9-abc1-2d23ce77edaa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:48.053937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6d0ed35-4365-4df9-abc1-2d23ce77edaa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:48.054421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d6d0ed35-4365-4df9-abc1-2d23ce77edaa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:48.090013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 03:59:48.090192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 03:59:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 03:59:48.188732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d6d0ed35-4365-4df9-abc1-2d23ce77edaa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:48.198605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d6d0ed35-4365-4df9-abc1-2d23ce77edaa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.159065 Apr 19 03:59:48.199252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 744/1536] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:48 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:49.216655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-641daf02-03f4-4168-a252-adf34f40c1a8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:49.217337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-641daf02-03f4-4168-a252-adf34f40c1a8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:49.225127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-641daf02-03f4-4168-a252-adf34f40c1a8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:49.225652 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-641daf02-03f4-4168-a252-adf34f40c1a8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:49.226461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-641daf02-03f4-4168-a252-adf34f40c1a8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:49.226953 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-641daf02-03f4-4168-a252-adf34f40c1a8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:49.357886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-641daf02-03f4-4168-a252-adf34f40c1a8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:49.367732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-641daf02-03f4-4168-a252-adf34f40c1a8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.155182 Apr 19 03:59:49.368350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 793/1537] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:49 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:50.386169 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-625a7ff5-ebaa-4b52-bcc8-1f4d607f73b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:50.386840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-625a7ff5-ebaa-4b52-bcc8-1f4d607f73b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:50.395179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-625a7ff5-ebaa-4b52-bcc8-1f4d607f73b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:50.395678 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-625a7ff5-ebaa-4b52-bcc8-1f4d607f73b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:50.396502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-625a7ff5-ebaa-4b52-bcc8-1f4d607f73b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:50.396990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-625a7ff5-ebaa-4b52-bcc8-1f4d607f73b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:50.518752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-625a7ff5-ebaa-4b52-bcc8-1f4d607f73b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:50.528461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-625a7ff5-ebaa-4b52-bcc8-1f4d607f73b8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146334 Apr 19 03:59:50.529662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 745/1538] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:50 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:51.547585 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-444234ef-2326-4461-8bf4-cf5d3ecfc4f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:51.548265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-444234ef-2326-4461-8bf4-cf5d3ecfc4f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:51.556249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-444234ef-2326-4461-8bf4-cf5d3ecfc4f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:51.556755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-444234ef-2326-4461-8bf4-cf5d3ecfc4f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:51.557588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-444234ef-2326-4461-8bf4-cf5d3ecfc4f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:51.558079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-444234ef-2326-4461-8bf4-cf5d3ecfc4f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:51.680543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-444234ef-2326-4461-8bf4-cf5d3ecfc4f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:51.690419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-444234ef-2326-4461-8bf4-cf5d3ecfc4f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147633 Apr 19 03:59:51.691039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 794/1539] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:51 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:52.707704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d495f00d-8395-44a4-96c1-e7b807c9a83d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:52.708374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d495f00d-8395-44a4-96c1-e7b807c9a83d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:52.716245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d495f00d-8395-44a4-96c1-e7b807c9a83d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:52.716750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d495f00d-8395-44a4-96c1-e7b807c9a83d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:52.717581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d495f00d-8395-44a4-96c1-e7b807c9a83d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:52.718069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d495f00d-8395-44a4-96c1-e7b807c9a83d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:52.843589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d495f00d-8395-44a4-96c1-e7b807c9a83d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:52.853338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d495f00d-8395-44a4-96c1-e7b807c9a83d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149843 Apr 19 03:59:52.853955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 746/1540] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:52 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:53.872805 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dee4f2d4-ba09-4184-ae11-e5f9a4c870f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:53.873484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dee4f2d4-ba09-4184-ae11-e5f9a4c870f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:53.881507 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dee4f2d4-ba09-4184-ae11-e5f9a4c870f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:53.882010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dee4f2d4-ba09-4184-ae11-e5f9a4c870f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:53.882837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dee4f2d4-ba09-4184-ae11-e5f9a4c870f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:53.883357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dee4f2d4-ba09-4184-ae11-e5f9a4c870f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:54.005610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dee4f2d4-ba09-4184-ae11-e5f9a4c870f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:54.015416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dee4f2d4-ba09-4184-ae11-e5f9a4c870f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147473 Apr 19 03:59:54.016035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 795/1541] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:53 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:55.034009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-978b5f8e-3fd9-4e0e-8d56-c36e107c545b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:55.034684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-978b5f8e-3fd9-4e0e-8d56-c36e107c545b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:55.042578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-978b5f8e-3fd9-4e0e-8d56-c36e107c545b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:55.043085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-978b5f8e-3fd9-4e0e-8d56-c36e107c545b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:55.043950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-978b5f8e-3fd9-4e0e-8d56-c36e107c545b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:55.044432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-978b5f8e-3fd9-4e0e-8d56-c36e107c545b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:55.170101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-978b5f8e-3fd9-4e0e-8d56-c36e107c545b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:55.179967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-978b5f8e-3fd9-4e0e-8d56-c36e107c545b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150035 Apr 19 03:59:55.180577 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 747/1542] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:55 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:56.198623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-745a4758-05c8-4755-9748-b56652229f5e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:56.199332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-745a4758-05c8-4755-9748-b56652229f5e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:56.207693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-745a4758-05c8-4755-9748-b56652229f5e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:56.208206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-745a4758-05c8-4755-9748-b56652229f5e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:56.209050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-745a4758-05c8-4755-9748-b56652229f5e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:56.209555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-745a4758-05c8-4755-9748-b56652229f5e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:56.338014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-745a4758-05c8-4755-9748-b56652229f5e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:56.348501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-745a4758-05c8-4755-9748-b56652229f5e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.154005 Apr 19 03:59:56.349116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 796/1543] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:56 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:57.366116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-13b0fbe5-7a57-45e6-8810-cea38a04713e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:57.366788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-13b0fbe5-7a57-45e6-8810-cea38a04713e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:57.374966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13b0fbe5-7a57-45e6-8810-cea38a04713e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:57.375508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13b0fbe5-7a57-45e6-8810-cea38a04713e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:57.376326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13b0fbe5-7a57-45e6-8810-cea38a04713e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:57.376814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-13b0fbe5-7a57-45e6-8810-cea38a04713e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:57.498160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-13b0fbe5-7a57-45e6-8810-cea38a04713e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:57.507916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-13b0fbe5-7a57-45e6-8810-cea38a04713e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146276 Apr 19 03:59:57.508522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 748/1544] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:57 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:58.525668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-49cd86ad-9828-4861-bf94-7539bc62f75f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:58.526335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-49cd86ad-9828-4861-bf94-7539bc62f75f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:58.534710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49cd86ad-9828-4861-bf94-7539bc62f75f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:58.535350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49cd86ad-9828-4861-bf94-7539bc62f75f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:58.536186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49cd86ad-9828-4861-bf94-7539bc62f75f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:58.536684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49cd86ad-9828-4861-bf94-7539bc62f75f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:58.659392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-49cd86ad-9828-4861-bf94-7539bc62f75f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:58.669155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-49cd86ad-9828-4861-bf94-7539bc62f75f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147544 Apr 19 03:59:58.669765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 797/1545] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:58 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 03:59:59.687036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fc65dc3b-c8a5-4ecd-a565-6bab98221757 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 03:59:59.687773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fc65dc3b-c8a5-4ecd-a565-6bab98221757 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 03:59:59.695655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc65dc3b-c8a5-4ecd-a565-6bab98221757 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:59.696166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc65dc3b-c8a5-4ecd-a565-6bab98221757 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:59.697007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc65dc3b-c8a5-4ecd-a565-6bab98221757 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 03:59:59.697503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc65dc3b-c8a5-4ecd-a565-6bab98221757 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 03:59:59.822669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fc65dc3b-c8a5-4ecd-a565-6bab98221757 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 03:59:59.832615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fc65dc3b-c8a5-4ecd-a565-6bab98221757 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149653 Apr 19 03:59:59.833227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 749/1546] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 03:59:59 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:00.851336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5c8b38ca-2d14-446b-9c15-bf40b2efba85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:00.851954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5c8b38ca-2d14-446b-9c15-bf40b2efba85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:00.860244 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c8b38ca-2d14-446b-9c15-bf40b2efba85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:00.860747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c8b38ca-2d14-446b-9c15-bf40b2efba85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:00.861563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c8b38ca-2d14-446b-9c15-bf40b2efba85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:00.862045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c8b38ca-2d14-446b-9c15-bf40b2efba85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:00.984128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5c8b38ca-2d14-446b-9c15-bf40b2efba85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:00.994205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5c8b38ca-2d14-446b-9c15-bf40b2efba85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147209 Apr 19 04:00:00.994827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 798/1547] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:00 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:02.013622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-de77ecba-f4f6-465a-9f84-b496a2d1876c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:02.014287 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-de77ecba-f4f6-465a-9f84-b496a2d1876c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:02.022143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de77ecba-f4f6-465a-9f84-b496a2d1876c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:02.022641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de77ecba-f4f6-465a-9f84-b496a2d1876c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:02.023492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de77ecba-f4f6-465a-9f84-b496a2d1876c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:02.023978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-de77ecba-f4f6-465a-9f84-b496a2d1876c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:02.149298 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-de77ecba-f4f6-465a-9f84-b496a2d1876c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:02.159088 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-de77ecba-f4f6-465a-9f84-b496a2d1876c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150160 Apr 19 04:00:02.159722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 750/1548] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:02 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:03.177834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-02c69d2d-cff7-41bd-940c-c06b662dba70 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:03.178581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-02c69d2d-cff7-41bd-940c-c06b662dba70 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:03.187096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02c69d2d-cff7-41bd-940c-c06b662dba70 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:03.187629 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02c69d2d-cff7-41bd-940c-c06b662dba70 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:03.188464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02c69d2d-cff7-41bd-940c-c06b662dba70 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:03.188996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-02c69d2d-cff7-41bd-940c-c06b662dba70 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:03.317001 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-02c69d2d-cff7-41bd-940c-c06b662dba70 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:03.326835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-02c69d2d-cff7-41bd-940c-c06b662dba70 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.153267 Apr 19 04:00:03.327489 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 799/1549] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:03 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:04.345061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cd5e4c1c-817d-493c-b309-f4fc3b6c06a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:04.353167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cd5e4c1c-817d-493c-b309-f4fc3b6c06a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:04.353488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd5e4c1c-817d-493c-b309-f4fc3b6c06a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:04.353995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd5e4c1c-817d-493c-b309-f4fc3b6c06a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:04.354830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd5e4c1c-817d-493c-b309-f4fc3b6c06a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:04.355358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd5e4c1c-817d-493c-b309-f4fc3b6c06a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:04.478014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cd5e4c1c-817d-493c-b309-f4fc3b6c06a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:04.488409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cd5e4c1c-817d-493c-b309-f4fc3b6c06a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147423 Apr 19 04:00:04.488951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 751/1550] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:04 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:05.507044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c0a8f0f8-1734-4145-a56e-198cdd3da6f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:05.507751 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c0a8f0f8-1734-4145-a56e-198cdd3da6f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:05.516091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0a8f0f8-1734-4145-a56e-198cdd3da6f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:05.516593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0a8f0f8-1734-4145-a56e-198cdd3da6f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:05.517419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0a8f0f8-1734-4145-a56e-198cdd3da6f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:05.517904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c0a8f0f8-1734-4145-a56e-198cdd3da6f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:05.641096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c0a8f0f8-1734-4145-a56e-198cdd3da6f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:05.651119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c0a8f0f8-1734-4145-a56e-198cdd3da6f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148088 Apr 19 04:00:05.651768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 800/1551] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:05 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:06.437510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:00:06.437704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:00:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:00:06.669282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b2fbf946-7216-4019-a9b3-b07fb9d6b083 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:06.670009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b2fbf946-7216-4019-a9b3-b07fb9d6b083 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:06.677961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2fbf946-7216-4019-a9b3-b07fb9d6b083 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:06.678420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2fbf946-7216-4019-a9b3-b07fb9d6b083 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:06.679334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2fbf946-7216-4019-a9b3-b07fb9d6b083 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:06.679836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2fbf946-7216-4019-a9b3-b07fb9d6b083 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:06.805839 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b2fbf946-7216-4019-a9b3-b07fb9d6b083 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:06.815975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b2fbf946-7216-4019-a9b3-b07fb9d6b083 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150955 Apr 19 04:00:06.816592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 752/1552] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:06 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:07.833734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-689e434b-0cf5-44f8-bb3f-b1922d8c60d5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:07.834402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-689e434b-0cf5-44f8-bb3f-b1922d8c60d5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:07.842774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-689e434b-0cf5-44f8-bb3f-b1922d8c60d5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:07.843205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-689e434b-0cf5-44f8-bb3f-b1922d8c60d5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:07.844042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-689e434b-0cf5-44f8-bb3f-b1922d8c60d5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:07.844531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-689e434b-0cf5-44f8-bb3f-b1922d8c60d5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:07.965929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-689e434b-0cf5-44f8-bb3f-b1922d8c60d5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:07.976220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-689e434b-0cf5-44f8-bb3f-b1922d8c60d5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146559 Apr 19 04:00:07.976844 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 801/1553] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:07 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:08.993947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1187c896-dcaf-47c7-ba60-4242731db922 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:08.994615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1187c896-dcaf-47c7-ba60-4242731db922 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:09.003603 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1187c896-dcaf-47c7-ba60-4242731db922 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:09.004152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1187c896-dcaf-47c7-ba60-4242731db922 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:09.004971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1187c896-dcaf-47c7-ba60-4242731db922 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:09.005453 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1187c896-dcaf-47c7-ba60-4242731db922 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:09.130345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1187c896-dcaf-47c7-ba60-4242731db922 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:09.140178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1187c896-dcaf-47c7-ba60-4242731db922 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150255 Apr 19 04:00:09.140788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 753/1554] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:08 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:10.157997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-26624be3-c7c0-4b12-8ea1-2c582d6aa236 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:10.158668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-26624be3-c7c0-4b12-8ea1-2c582d6aa236 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:10.166607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-26624be3-c7c0-4b12-8ea1-2c582d6aa236 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:10.167116 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-26624be3-c7c0-4b12-8ea1-2c582d6aa236 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:10.167993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-26624be3-c7c0-4b12-8ea1-2c582d6aa236 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:10.168482 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-26624be3-c7c0-4b12-8ea1-2c582d6aa236 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:10.296120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-26624be3-c7c0-4b12-8ea1-2c582d6aa236 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:10.305966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-26624be3-c7c0-4b12-8ea1-2c582d6aa236 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152017 Apr 19 04:00:10.306575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 802/1555] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:10 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:11.324616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-08dcc3b4-9eec-4645-a2e0-f10234b3fd82 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:11.325281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-08dcc3b4-9eec-4645-a2e0-f10234b3fd82 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:11.334007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08dcc3b4-9eec-4645-a2e0-f10234b3fd82 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:11.334504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08dcc3b4-9eec-4645-a2e0-f10234b3fd82 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:11.335364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08dcc3b4-9eec-4645-a2e0-f10234b3fd82 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:11.335857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-08dcc3b4-9eec-4645-a2e0-f10234b3fd82 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:11.457790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-08dcc3b4-9eec-4645-a2e0-f10234b3fd82 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:11.468408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-08dcc3b4-9eec-4645-a2e0-f10234b3fd82 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147864 Apr 19 04:00:11.469026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 754/1556] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:11 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:12.486664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3aa56118-c52f-45e0-9ec8-7f28c90cfb54 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:12.487389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3aa56118-c52f-45e0-9ec8-7f28c90cfb54 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:12.495370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3aa56118-c52f-45e0-9ec8-7f28c90cfb54 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:12.495880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3aa56118-c52f-45e0-9ec8-7f28c90cfb54 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:12.496965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3aa56118-c52f-45e0-9ec8-7f28c90cfb54 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:12.497454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3aa56118-c52f-45e0-9ec8-7f28c90cfb54 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:12.620018 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3aa56118-c52f-45e0-9ec8-7f28c90cfb54 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:12.630127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3aa56118-c52f-45e0-9ec8-7f28c90cfb54 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148116 Apr 19 04:00:12.630739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 803/1557] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:12 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:13.648550 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-aad78a88-5a6c-423d-80bb-c8b5fac4faff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:13.649236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-aad78a88-5a6c-423d-80bb-c8b5fac4faff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:13.657089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aad78a88-5a6c-423d-80bb-c8b5fac4faff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:13.657600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aad78a88-5a6c-423d-80bb-c8b5fac4faff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:13.658437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aad78a88-5a6c-423d-80bb-c8b5fac4faff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:13.658932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aad78a88-5a6c-423d-80bb-c8b5fac4faff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:13.785136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-aad78a88-5a6c-423d-80bb-c8b5fac4faff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:13.795717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-aad78a88-5a6c-423d-80bb-c8b5fac4faff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150607 Apr 19 04:00:13.796335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 755/1558] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:13 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:14.814255 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-af5d7746-f66c-444e-9185-c58a2094e033 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:14.814917 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-af5d7746-f66c-444e-9185-c58a2094e033 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:14.822653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af5d7746-f66c-444e-9185-c58a2094e033 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:14.823182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af5d7746-f66c-444e-9185-c58a2094e033 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:14.824002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af5d7746-f66c-444e-9185-c58a2094e033 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:14.824486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-af5d7746-f66c-444e-9185-c58a2094e033 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:14.946807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-af5d7746-f66c-444e-9185-c58a2094e033 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:14.956952 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-af5d7746-f66c-444e-9185-c58a2094e033 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147364 Apr 19 04:00:14.957563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 804/1559] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:14 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:15.974963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e77000b3-8ca0-4663-a64a-6b214507f4ea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:15.975720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e77000b3-8ca0-4663-a64a-6b214507f4ea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:15.983573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e77000b3-8ca0-4663-a64a-6b214507f4ea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:15.984089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e77000b3-8ca0-4663-a64a-6b214507f4ea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:15.984934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e77000b3-8ca0-4663-a64a-6b214507f4ea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:15.985426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e77000b3-8ca0-4663-a64a-6b214507f4ea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:16.110278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e77000b3-8ca0-4663-a64a-6b214507f4ea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:16.120042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e77000b3-8ca0-4663-a64a-6b214507f4ea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149210 Apr 19 04:00:16.120656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 756/1560] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:15 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:17.139291 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6762905c-9608-4b41-9fd9-bfffae19837e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:17.139957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6762905c-9608-4b41-9fd9-bfffae19837e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:17.147813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6762905c-9608-4b41-9fd9-bfffae19837e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:17.148318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6762905c-9608-4b41-9fd9-bfffae19837e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:17.149140 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6762905c-9608-4b41-9fd9-bfffae19837e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:17.149624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6762905c-9608-4b41-9fd9-bfffae19837e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:17.276421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6762905c-9608-4b41-9fd9-bfffae19837e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:17.286816 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6762905c-9608-4b41-9fd9-bfffae19837e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152301 Apr 19 04:00:17.287449 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 805/1561] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:17 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:18.305025 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-82f39788-2ed7-45d6-b68e-cce9933d0681 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:18.305753 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-82f39788-2ed7-45d6-b68e-cce9933d0681 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:18.313562 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82f39788-2ed7-45d6-b68e-cce9933d0681 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:18.314069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82f39788-2ed7-45d6-b68e-cce9933d0681 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:18.314902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82f39788-2ed7-45d6-b68e-cce9933d0681 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:18.315422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82f39788-2ed7-45d6-b68e-cce9933d0681 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:18.438464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-82f39788-2ed7-45d6-b68e-cce9933d0681 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:18.448366 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-82f39788-2ed7-45d6-b68e-cce9933d0681 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147490 Apr 19 04:00:18.448979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 757/1562] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:18 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:19.466365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-71f3e1b7-30a0-4c35-8225-cca888c09e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:19.467624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-71f3e1b7-30a0-4c35-8225-cca888c09e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:19.475502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71f3e1b7-30a0-4c35-8225-cca888c09e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:19.476003 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71f3e1b7-30a0-4c35-8225-cca888c09e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:19.476825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71f3e1b7-30a0-4c35-8225-cca888c09e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:19.477311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-71f3e1b7-30a0-4c35-8225-cca888c09e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:19.600572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-71f3e1b7-30a0-4c35-8225-cca888c09e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:19.610698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-71f3e1b7-30a0-4c35-8225-cca888c09e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148483 Apr 19 04:00:19.611559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 806/1563] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:19 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:20.629397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bba40d1b-e3cd-4ed4-8857-76a6b306d79e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:20.630069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bba40d1b-e3cd-4ed4-8857-76a6b306d79e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:20.638089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bba40d1b-e3cd-4ed4-8857-76a6b306d79e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:20.639206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bba40d1b-e3cd-4ed4-8857-76a6b306d79e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:20.640040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bba40d1b-e3cd-4ed4-8857-76a6b306d79e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:20.640531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bba40d1b-e3cd-4ed4-8857-76a6b306d79e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:20.767266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bba40d1b-e3cd-4ed4-8857-76a6b306d79e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:20.777399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bba40d1b-e3cd-4ed4-8857-76a6b306d79e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152219 Apr 19 04:00:20.778013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 758/1564] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:20 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:21.795893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-66c2f820-ab71-41fd-a1e2-3b30850754bb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:21.796538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-66c2f820-ab71-41fd-a1e2-3b30850754bb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:21.804378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66c2f820-ab71-41fd-a1e2-3b30850754bb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:21.804883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66c2f820-ab71-41fd-a1e2-3b30850754bb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:21.805705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66c2f820-ab71-41fd-a1e2-3b30850754bb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:21.806187 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-66c2f820-ab71-41fd-a1e2-3b30850754bb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:21.929683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-66c2f820-ab71-41fd-a1e2-3b30850754bb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:21.940385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-66c2f820-ab71-41fd-a1e2-3b30850754bb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149264 Apr 19 04:00:21.943197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 807/1565] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:21 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:22.959228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5f7491dd-b86e-4b4d-8105-3f0765c83456 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:22.959901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5f7491dd-b86e-4b4d-8105-3f0765c83456 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:22.968239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f7491dd-b86e-4b4d-8105-3f0765c83456 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:22.968736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f7491dd-b86e-4b4d-8105-3f0765c83456 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:22.969556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f7491dd-b86e-4b4d-8105-3f0765c83456 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:22.970039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f7491dd-b86e-4b4d-8105-3f0765c83456 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:23.094982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5f7491dd-b86e-4b4d-8105-3f0765c83456 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:23.104907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5f7491dd-b86e-4b4d-8105-3f0765c83456 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149739 Apr 19 04:00:23.105516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 759/1566] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:22 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:24.124742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3e77cd29-8097-4103-a892-d896d58d8fec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:24.125415 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3e77cd29-8097-4103-a892-d896d58d8fec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:24.133226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e77cd29-8097-4103-a892-d896d58d8fec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:24.133734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e77cd29-8097-4103-a892-d896d58d8fec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:24.134569 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e77cd29-8097-4103-a892-d896d58d8fec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:24.135064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3e77cd29-8097-4103-a892-d896d58d8fec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:24.264152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3e77cd29-8097-4103-a892-d896d58d8fec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:24.274258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3e77cd29-8097-4103-a892-d896d58d8fec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.154656 Apr 19 04:00:24.274931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 808/1567] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:24 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:25.292438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-10659043-3350-440e-91ff-11cd665654e7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:25.293104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-10659043-3350-440e-91ff-11cd665654e7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:25.301630 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10659043-3350-440e-91ff-11cd665654e7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:25.302150 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10659043-3350-440e-91ff-11cd665654e7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:25.302993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10659043-3350-440e-91ff-11cd665654e7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:25.303522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10659043-3350-440e-91ff-11cd665654e7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:25.428942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-10659043-3350-440e-91ff-11cd665654e7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:25.438993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-10659043-3350-440e-91ff-11cd665654e7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150626 Apr 19 04:00:25.439646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 760/1568] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:25 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:26.456906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e94d9c55-86b1-4af0-8959-e8045af23156 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:26.457618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e94d9c55-86b1-4af0-8959-e8045af23156 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:26.465413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e94d9c55-86b1-4af0-8959-e8045af23156 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:26.465918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e94d9c55-86b1-4af0-8959-e8045af23156 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:26.466740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e94d9c55-86b1-4af0-8959-e8045af23156 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:26.467410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e94d9c55-86b1-4af0-8959-e8045af23156 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:26.589769 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e94d9c55-86b1-4af0-8959-e8045af23156 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:26.600280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e94d9c55-86b1-4af0-8959-e8045af23156 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147456 Apr 19 04:00:26.600891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 809/1569] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:26 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:27.618638 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2d4a4f0c-b08f-4ae1-9dd2-6ad5108ab5e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:27.619347 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2d4a4f0c-b08f-4ae1-9dd2-6ad5108ab5e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:27.628125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d4a4f0c-b08f-4ae1-9dd2-6ad5108ab5e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:27.628632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d4a4f0c-b08f-4ae1-9dd2-6ad5108ab5e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:27.629469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d4a4f0c-b08f-4ae1-9dd2-6ad5108ab5e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:27.629965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d4a4f0c-b08f-4ae1-9dd2-6ad5108ab5e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:27.758477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2d4a4f0c-b08f-4ae1-9dd2-6ad5108ab5e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:27.768411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2d4a4f0c-b08f-4ae1-9dd2-6ad5108ab5e6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.153834 Apr 19 04:00:27.769034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 761/1570] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:27 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:28.786704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c34c70fb-8648-4740-8ed0-a325e54add44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:28.787522 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c34c70fb-8648-4740-8ed0-a325e54add44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:28.796583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c34c70fb-8648-4740-8ed0-a325e54add44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:28.797096 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c34c70fb-8648-4740-8ed0-a325e54add44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:28.797927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c34c70fb-8648-4740-8ed0-a325e54add44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:28.798419 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c34c70fb-8648-4740-8ed0-a325e54add44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:28.921477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c34c70fb-8648-4740-8ed0-a325e54add44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:28.931332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c34c70fb-8648-4740-8ed0-a325e54add44 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148957 Apr 19 04:00:28.931943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 810/1571] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:28 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:29.949890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2d5d9251-a8f2-4dea-b70c-b9c6c4a3c6bf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:29.950615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2d5d9251-a8f2-4dea-b70c-b9c6c4a3c6bf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:29.958947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d5d9251-a8f2-4dea-b70c-b9c6c4a3c6bf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:29.959518 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d5d9251-a8f2-4dea-b70c-b9c6c4a3c6bf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:29.960395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d5d9251-a8f2-4dea-b70c-b9c6c4a3c6bf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:29.960892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2d5d9251-a8f2-4dea-b70c-b9c6c4a3c6bf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:30.086144 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2d5d9251-a8f2-4dea-b70c-b9c6c4a3c6bf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:30.096640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2d5d9251-a8f2-4dea-b70c-b9c6c4a3c6bf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150943 Apr 19 04:00:30.097261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 762/1572] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:29 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:31.114967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-554f310c-4366-45f9-8bf0-979215906b20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:31.115665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-554f310c-4366-45f9-8bf0-979215906b20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:31.123845 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-554f310c-4366-45f9-8bf0-979215906b20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:31.124356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-554f310c-4366-45f9-8bf0-979215906b20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:31.125184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-554f310c-4366-45f9-8bf0-979215906b20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:31.125676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-554f310c-4366-45f9-8bf0-979215906b20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:31.253457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-554f310c-4366-45f9-8bf0-979215906b20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:31.263420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-554f310c-4366-45f9-8bf0-979215906b20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152596 Apr 19 04:00:31.264084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 811/1573] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:31 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:32.281510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-263d33cf-4c9a-4245-a2d6-7d39ac30fcb8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:32.282189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-263d33cf-4c9a-4245-a2d6-7d39ac30fcb8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:32.290065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-263d33cf-4c9a-4245-a2d6-7d39ac30fcb8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:32.290571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-263d33cf-4c9a-4245-a2d6-7d39ac30fcb8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:32.291429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-263d33cf-4c9a-4245-a2d6-7d39ac30fcb8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:32.291921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-263d33cf-4c9a-4245-a2d6-7d39ac30fcb8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:32.414370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-263d33cf-4c9a-4245-a2d6-7d39ac30fcb8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:32.424664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-263d33cf-4c9a-4245-a2d6-7d39ac30fcb8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147373 Apr 19 04:00:32.425278 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 763/1574] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:32 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:33.443087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b711d933-5e3b-46c7-bfbd-f7ac561a47de tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:33.443794 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b711d933-5e3b-46c7-bfbd-f7ac561a47de tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:33.452268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b711d933-5e3b-46c7-bfbd-f7ac561a47de tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:33.452774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b711d933-5e3b-46c7-bfbd-f7ac561a47de tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:33.453610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b711d933-5e3b-46c7-bfbd-f7ac561a47de tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:33.454094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b711d933-5e3b-46c7-bfbd-f7ac561a47de tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:33.577132 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b711d933-5e3b-46c7-bfbd-f7ac561a47de tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:33.587222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b711d933-5e3b-46c7-bfbd-f7ac561a47de tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148299 Apr 19 04:00:33.587854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 812/1575] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:33 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:34.605520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cb71998e-fe15-499d-8f5f-d7d69ad9f2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:34.606188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cb71998e-fe15-499d-8f5f-d7d69ad9f2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:34.613998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb71998e-fe15-499d-8f5f-d7d69ad9f2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:34.614501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb71998e-fe15-499d-8f5f-d7d69ad9f2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:34.615352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb71998e-fe15-499d-8f5f-d7d69ad9f2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:34.615879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cb71998e-fe15-499d-8f5f-d7d69ad9f2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:34.744095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cb71998e-fe15-499d-8f5f-d7d69ad9f2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:34.754776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cb71998e-fe15-499d-8f5f-d7d69ad9f2da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.153482 Apr 19 04:00:34.755407 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 764/1576] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:34 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:35.773374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ac54bb0e-aaaa-4fdd-8162-a6b55c79bcc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:35.774049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ac54bb0e-aaaa-4fdd-8162-a6b55c79bcc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:35.782463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ac54bb0e-aaaa-4fdd-8162-a6b55c79bcc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:35.782971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ac54bb0e-aaaa-4fdd-8162-a6b55c79bcc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:35.783881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ac54bb0e-aaaa-4fdd-8162-a6b55c79bcc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:35.784375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ac54bb0e-aaaa-4fdd-8162-a6b55c79bcc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:35.907189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ac54bb0e-aaaa-4fdd-8162-a6b55c79bcc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:35.916942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ac54bb0e-aaaa-4fdd-8162-a6b55c79bcc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147691 Apr 19 04:00:35.917558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 813/1577] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:35 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:36.934516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c88e0470-b04f-4e8b-9086-3df1a209abea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:36.935193 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c88e0470-b04f-4e8b-9086-3df1a209abea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:36.943207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c88e0470-b04f-4e8b-9086-3df1a209abea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:36.943721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c88e0470-b04f-4e8b-9086-3df1a209abea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:36.944549 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c88e0470-b04f-4e8b-9086-3df1a209abea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:36.945032 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c88e0470-b04f-4e8b-9086-3df1a209abea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:37.070708 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c88e0470-b04f-4e8b-9086-3df1a209abea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:37.081180 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c88e0470-b04f-4e8b-9086-3df1a209abea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150798 Apr 19 04:00:37.081796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 765/1578] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:36 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:38.099243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-24e90527-c0b0-4fd5-bca6-80088e788b58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:38.099921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-24e90527-c0b0-4fd5-bca6-80088e788b58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:38.108390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24e90527-c0b0-4fd5-bca6-80088e788b58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:38.108897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24e90527-c0b0-4fd5-bca6-80088e788b58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:38.109727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24e90527-c0b0-4fd5-bca6-80088e788b58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:38.110217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-24e90527-c0b0-4fd5-bca6-80088e788b58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:38.239653 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-24e90527-c0b0-4fd5-bca6-80088e788b58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:38.249860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-24e90527-c0b0-4fd5-bca6-80088e788b58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.154833 Apr 19 04:00:38.250472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 814/1579] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:38 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:39.267904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a1d66602-fe42-4890-87a1-3156f48d5d3f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:39.268531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a1d66602-fe42-4890-87a1-3156f48d5d3f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:39.276462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1d66602-fe42-4890-87a1-3156f48d5d3f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:39.276997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1d66602-fe42-4890-87a1-3156f48d5d3f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:39.277824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1d66602-fe42-4890-87a1-3156f48d5d3f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:39.278317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a1d66602-fe42-4890-87a1-3156f48d5d3f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:39.403109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a1d66602-fe42-4890-87a1-3156f48d5d3f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:39.413574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a1d66602-fe42-4890-87a1-3156f48d5d3f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149844 Apr 19 04:00:39.414185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 766/1580] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:39 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:40.431912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cf549a3f-113a-4e3b-9817-a4453d680d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:40.432584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cf549a3f-113a-4e3b-9817-a4453d680d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:40.440802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf549a3f-113a-4e3b-9817-a4453d680d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:40.441316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf549a3f-113a-4e3b-9817-a4453d680d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:40.442149 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf549a3f-113a-4e3b-9817-a4453d680d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:40.442639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cf549a3f-113a-4e3b-9817-a4453d680d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:40.568487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cf549a3f-113a-4e3b-9817-a4453d680d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:40.579463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cf549a3f-113a-4e3b-9817-a4453d680d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151539 Apr 19 04:00:40.581718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 815/1581] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:40 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:41.598175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-98c4010d-c198-4601-a6d9-a229687372d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:41.598849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-98c4010d-c198-4601-a6d9-a229687372d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:41.606695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98c4010d-c198-4601-a6d9-a229687372d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:41.607237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98c4010d-c198-4601-a6d9-a229687372d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:41.608065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98c4010d-c198-4601-a6d9-a229687372d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:41.608553 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-98c4010d-c198-4601-a6d9-a229687372d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:41.735636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-98c4010d-c198-4601-a6d9-a229687372d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:41.746108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-98c4010d-c198-4601-a6d9-a229687372d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152482 Apr 19 04:00:41.746966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 767/1582] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:41 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:42.765065 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e1b65886-c756-411f-bd9c-0cc8942db983 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:42.765757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e1b65886-c756-411f-bd9c-0cc8942db983 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:42.773672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1b65886-c756-411f-bd9c-0cc8942db983 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:42.774179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1b65886-c756-411f-bd9c-0cc8942db983 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:42.775013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1b65886-c756-411f-bd9c-0cc8942db983 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:42.775529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e1b65886-c756-411f-bd9c-0cc8942db983 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:42.899208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e1b65886-c756-411f-bd9c-0cc8942db983 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:42.909166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e1b65886-c756-411f-bd9c-0cc8942db983 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148322 Apr 19 04:00:42.909784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 816/1583] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:42 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:43.926194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0c9f496f-f0d5-47c4-8845-bc0eb6de9efd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:43.926872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0c9f496f-f0d5-47c4-8845-bc0eb6de9efd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:43.934925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c9f496f-f0d5-47c4-8845-bc0eb6de9efd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:43.936175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c9f496f-f0d5-47c4-8845-bc0eb6de9efd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:43.937009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c9f496f-f0d5-47c4-8845-bc0eb6de9efd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:43.937584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0c9f496f-f0d5-47c4-8845-bc0eb6de9efd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:44.063746 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0c9f496f-f0d5-47c4-8845-bc0eb6de9efd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:44.073566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0c9f496f-f0d5-47c4-8845-bc0eb6de9efd tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151486 Apr 19 04:00:44.074173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 768/1584] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:43 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:45.091944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d545a273-4dbe-4eba-862e-e5e4c137caca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:45.092625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d545a273-4dbe-4eba-862e-e5e4c137caca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:45.100511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d545a273-4dbe-4eba-862e-e5e4c137caca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:45.101021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d545a273-4dbe-4eba-862e-e5e4c137caca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:45.101859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d545a273-4dbe-4eba-862e-e5e4c137caca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:45.102353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d545a273-4dbe-4eba-862e-e5e4c137caca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:45.230056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d545a273-4dbe-4eba-862e-e5e4c137caca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:45.239966 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d545a273-4dbe-4eba-862e-e5e4c137caca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152669 Apr 19 04:00:45.240581 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 817/1585] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:45 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:46.258127 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4b13c408-5d64-4a15-9677-290aeb0e881f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:46.258802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4b13c408-5d64-4a15-9677-290aeb0e881f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:46.267243 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b13c408-5d64-4a15-9677-290aeb0e881f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:46.267747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b13c408-5d64-4a15-9677-290aeb0e881f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:46.268572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b13c408-5d64-4a15-9677-290aeb0e881f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:46.269062 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b13c408-5d64-4a15-9677-290aeb0e881f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:46.391418 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4b13c408-5d64-4a15-9677-290aeb0e881f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:46.401226 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4b13c408-5d64-4a15-9677-290aeb0e881f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147195 Apr 19 04:00:46.401835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 769/1586] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:46 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:47.418780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7142210e-790e-484b-b92b-772fb2ad4ce9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:47.419558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7142210e-790e-484b-b92b-772fb2ad4ce9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:47.427481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7142210e-790e-484b-b92b-772fb2ad4ce9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:47.427984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7142210e-790e-484b-b92b-772fb2ad4ce9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:47.428818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7142210e-790e-484b-b92b-772fb2ad4ce9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:47.429307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7142210e-790e-484b-b92b-772fb2ad4ce9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:47.552559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7142210e-790e-484b-b92b-772fb2ad4ce9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:47.563072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7142210e-790e-484b-b92b-772fb2ad4ce9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148381 Apr 19 04:00:47.563723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 818/1587] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:47 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:48.581311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5ed3fbea-70d4-4e2b-8c3b-944dc0369058 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:48.581920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5ed3fbea-70d4-4e2b-8c3b-944dc0369058 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:48.590119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ed3fbea-70d4-4e2b-8c3b-944dc0369058 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:48.590627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ed3fbea-70d4-4e2b-8c3b-944dc0369058 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:48.591985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ed3fbea-70d4-4e2b-8c3b-944dc0369058 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:48.592477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ed3fbea-70d4-4e2b-8c3b-944dc0369058 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:48.718961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5ed3fbea-70d4-4e2b-8c3b-944dc0369058 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:48.728828 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5ed3fbea-70d4-4e2b-8c3b-944dc0369058 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151802 Apr 19 04:00:48.729451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 770/1588] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:48 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:49.747167 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dddd5913-6c1c-4dfe-a23c-35481c04da8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:49.748348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dddd5913-6c1c-4dfe-a23c-35481c04da8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:49.756294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dddd5913-6c1c-4dfe-a23c-35481c04da8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:49.756801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dddd5913-6c1c-4dfe-a23c-35481c04da8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:49.757623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dddd5913-6c1c-4dfe-a23c-35481c04da8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:49.758109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dddd5913-6c1c-4dfe-a23c-35481c04da8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:49.879340 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dddd5913-6c1c-4dfe-a23c-35481c04da8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:49.889721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dddd5913-6c1c-4dfe-a23c-35481c04da8d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146964 Apr 19 04:00:49.890346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 819/1589] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:49 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:50.908386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f8941ffa-3db7-486a-ac52-9475b61cc27c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:50.909059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f8941ffa-3db7-486a-ac52-9475b61cc27c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:50.916892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8941ffa-3db7-486a-ac52-9475b61cc27c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:50.917399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8941ffa-3db7-486a-ac52-9475b61cc27c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:50.918229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8941ffa-3db7-486a-ac52-9475b61cc27c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:50.918721 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8941ffa-3db7-486a-ac52-9475b61cc27c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:51.043706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f8941ffa-3db7-486a-ac52-9475b61cc27c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:51.053481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f8941ffa-3db7-486a-ac52-9475b61cc27c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149952 Apr 19 04:00:51.054092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 771/1590] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:50 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:52.072103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-77c740e9-3cc5-4d9c-8caa-140c51af31ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:52.072768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-77c740e9-3cc5-4d9c-8caa-140c51af31ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:52.080598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77c740e9-3cc5-4d9c-8caa-140c51af31ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:52.081093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77c740e9-3cc5-4d9c-8caa-140c51af31ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:52.081922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77c740e9-3cc5-4d9c-8caa-140c51af31ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:52.082408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-77c740e9-3cc5-4d9c-8caa-140c51af31ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:52.209175 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-77c740e9-3cc5-4d9c-8caa-140c51af31ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:52.219373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-77c740e9-3cc5-4d9c-8caa-140c51af31ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151395 Apr 19 04:00:52.219985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 820/1591] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:52 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:53.237976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4a2e6372-ab6e-4755-abac-1d5a5021e2a7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:53.238589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4a2e6372-ab6e-4755-abac-1d5a5021e2a7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:53.246386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a2e6372-ab6e-4755-abac-1d5a5021e2a7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:53.247177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a2e6372-ab6e-4755-abac-1d5a5021e2a7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:53.247994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a2e6372-ab6e-4755-abac-1d5a5021e2a7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:53.249046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a2e6372-ab6e-4755-abac-1d5a5021e2a7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:53.371093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4a2e6372-ab6e-4755-abac-1d5a5021e2a7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:53.381841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4a2e6372-ab6e-4755-abac-1d5a5021e2a7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148118 Apr 19 04:00:53.382457 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 772/1592] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:53 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:54.400105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-99af5609-cd05-4ffa-9175-333c01cc927b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:54.400846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-99af5609-cd05-4ffa-9175-333c01cc927b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:54.408646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99af5609-cd05-4ffa-9175-333c01cc927b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:54.409156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99af5609-cd05-4ffa-9175-333c01cc927b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:54.409986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99af5609-cd05-4ffa-9175-333c01cc927b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:54.410561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-99af5609-cd05-4ffa-9175-333c01cc927b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:54.534202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-99af5609-cd05-4ffa-9175-333c01cc927b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:54.544101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-99af5609-cd05-4ffa-9175-333c01cc927b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148288 Apr 19 04:00:54.544722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 821/1593] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:54 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:55.562743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-eaee8e5c-9c82-4f7a-a083-8d6ff40e5800 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:55.563454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-eaee8e5c-9c82-4f7a-a083-8d6ff40e5800 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:55.571361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaee8e5c-9c82-4f7a-a083-8d6ff40e5800 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:55.571862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaee8e5c-9c82-4f7a-a083-8d6ff40e5800 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:55.572686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaee8e5c-9c82-4f7a-a083-8d6ff40e5800 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:55.573169 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-eaee8e5c-9c82-4f7a-a083-8d6ff40e5800 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:55.697961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-eaee8e5c-9c82-4f7a-a083-8d6ff40e5800 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:55.707767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-eaee8e5c-9c82-4f7a-a083-8d6ff40e5800 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149804 Apr 19 04:00:55.708400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 773/1594] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:55 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:56.726093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2a8a44af-256f-4eac-a391-3207b514fdd8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:56.726770 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2a8a44af-256f-4eac-a391-3207b514fdd8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:56.734665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a8a44af-256f-4eac-a391-3207b514fdd8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:56.735192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a8a44af-256f-4eac-a391-3207b514fdd8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:56.736027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a8a44af-256f-4eac-a391-3207b514fdd8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:56.736517 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2a8a44af-256f-4eac-a391-3207b514fdd8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:56.859089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2a8a44af-256f-4eac-a391-3207b514fdd8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:56.869051 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2a8a44af-256f-4eac-a391-3207b514fdd8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147120 Apr 19 04:00:56.869669 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 822/1595] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:56 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:57.888041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dbd5f13a-1e53-4090-9ae1-69cbc31b8ca8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:57.888644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dbd5f13a-1e53-4090-9ae1-69cbc31b8ca8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:57.896912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbd5f13a-1e53-4090-9ae1-69cbc31b8ca8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:57.897411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbd5f13a-1e53-4090-9ae1-69cbc31b8ca8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:57.898234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbd5f13a-1e53-4090-9ae1-69cbc31b8ca8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:57.898718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dbd5f13a-1e53-4090-9ae1-69cbc31b8ca8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:58.025337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dbd5f13a-1e53-4090-9ae1-69cbc31b8ca8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:58.035234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dbd5f13a-1e53-4090-9ae1-69cbc31b8ca8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151412 Apr 19 04:00:58.035849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 774/1596] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:57 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:00:59.053119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1cfb55f1-1b28-4120-bc2c-316af1c8ce7f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:00:59.053784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1cfb55f1-1b28-4120-bc2c-316af1c8ce7f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:00:59.061717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cfb55f1-1b28-4120-bc2c-316af1c8ce7f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:59.062220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cfb55f1-1b28-4120-bc2c-316af1c8ce7f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:59.063039 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cfb55f1-1b28-4120-bc2c-316af1c8ce7f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:00:59.063555 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cfb55f1-1b28-4120-bc2c-316af1c8ce7f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:00:59.190703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1cfb55f1-1b28-4120-bc2c-316af1c8ce7f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:00:59.200774 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1cfb55f1-1b28-4120-bc2c-316af1c8ce7f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151761 Apr 19 04:00:59.201450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 823/1597] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:00:59 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:00.220057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0fcce592-9ab9-4e87-becc-cdef6197cbb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:00.220732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0fcce592-9ab9-4e87-becc-cdef6197cbb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:00.228634 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0fcce592-9ab9-4e87-becc-cdef6197cbb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:00.229145 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0fcce592-9ab9-4e87-becc-cdef6197cbb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:00.229979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0fcce592-9ab9-4e87-becc-cdef6197cbb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:00.230476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0fcce592-9ab9-4e87-becc-cdef6197cbb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:00.353247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0fcce592-9ab9-4e87-becc-cdef6197cbb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:00.363878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0fcce592-9ab9-4e87-becc-cdef6197cbb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148633 Apr 19 04:01:00.364501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 775/1598] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:00 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:01.382181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-952605b3-23df-4bac-857e-458c1a9435fc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:01.382804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-952605b3-23df-4bac-857e-458c1a9435fc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:01.390683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-952605b3-23df-4bac-857e-458c1a9435fc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:01.391223 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-952605b3-23df-4bac-857e-458c1a9435fc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:01.392045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-952605b3-23df-4bac-857e-458c1a9435fc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:01.392531 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-952605b3-23df-4bac-857e-458c1a9435fc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:01.514863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-952605b3-23df-4bac-857e-458c1a9435fc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:01.525007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-952605b3-23df-4bac-857e-458c1a9435fc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146950 Apr 19 04:01:01.525637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 824/1599] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:01 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:02.543178 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-10424f76-087e-4351-afc5-dc936f71b808 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:02.543840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-10424f76-087e-4351-afc5-dc936f71b808 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:02.551881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10424f76-087e-4351-afc5-dc936f71b808 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:02.552392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10424f76-087e-4351-afc5-dc936f71b808 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:02.553221 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10424f76-087e-4351-afc5-dc936f71b808 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:02.553706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-10424f76-087e-4351-afc5-dc936f71b808 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:02.680683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-10424f76-087e-4351-afc5-dc936f71b808 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:02.691199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-10424f76-087e-4351-afc5-dc936f71b808 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152164 Apr 19 04:01:02.692004 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 776/1600] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:02 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:03.709131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f8e3c77c-9314-45fc-acb9-bf06fd286e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:03.709847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f8e3c77c-9314-45fc-acb9-bf06fd286e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:03.717857 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8e3c77c-9314-45fc-acb9-bf06fd286e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:03.718365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8e3c77c-9314-45fc-acb9-bf06fd286e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:03.719219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8e3c77c-9314-45fc-acb9-bf06fd286e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:03.719715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f8e3c77c-9314-45fc-acb9-bf06fd286e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:03.844763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f8e3c77c-9314-45fc-acb9-bf06fd286e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:03.854796 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f8e3c77c-9314-45fc-acb9-bf06fd286e49 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149805 Apr 19 04:01:03.855454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 825/1601] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:03 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:04.874014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-da85bf27-d2f3-4df6-a84c-7677a9949ddc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:04.874689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-da85bf27-d2f3-4df6-a84c-7677a9949ddc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:04.882512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da85bf27-d2f3-4df6-a84c-7677a9949ddc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:04.883008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da85bf27-d2f3-4df6-a84c-7677a9949ddc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:04.883862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da85bf27-d2f3-4df6-a84c-7677a9949ddc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:04.884345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-da85bf27-d2f3-4df6-a84c-7677a9949ddc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:05.010210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-da85bf27-d2f3-4df6-a84c-7677a9949ddc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:05.020787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-da85bf27-d2f3-4df6-a84c-7677a9949ddc tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151546 Apr 19 04:01:05.021391 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 777/1602] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:04 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:06.038160 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7dcbeb1e-1350-401a-933e-3e9eb3c96a08 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:06.038834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7dcbeb1e-1350-401a-933e-3e9eb3c96a08 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:06.046719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7dcbeb1e-1350-401a-933e-3e9eb3c96a08 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:06.047252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7dcbeb1e-1350-401a-933e-3e9eb3c96a08 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:06.048087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7dcbeb1e-1350-401a-933e-3e9eb3c96a08 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:06.048579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7dcbeb1e-1350-401a-933e-3e9eb3c96a08 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:06.176210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7dcbeb1e-1350-401a-933e-3e9eb3c96a08 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:06.186010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7dcbeb1e-1350-401a-933e-3e9eb3c96a08 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151975 Apr 19 04:01:06.186625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 826/1603] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:06 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:07.204443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-198305a7-b892-472c-a9c7-427d1d94fa38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:07.205058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-198305a7-b892-472c-a9c7-427d1d94fa38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:07.208295 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] AMQP server on 10.222.0.25:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 19 04:01:07.213544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-198305a7-b892-472c-a9c7-427d1d94fa38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:07.214045 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-198305a7-b892-472c-a9c7-427d1d94fa38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:07.214862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-198305a7-b892-472c-a9c7-427d1d94fa38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:07.215384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-198305a7-b892-472c-a9c7-427d1d94fa38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:07.337623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-198305a7-b892-472c-a9c7-427d1d94fa38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:07.347509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-198305a7-b892-472c-a9c7-427d1d94fa38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147755 Apr 19 04:01:07.348101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 778/1604] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:07 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:08.365348 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8ba17794-f800-4dc3-a479-0301c99bfa23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:08.365957 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8ba17794-f800-4dc3-a479-0301c99bfa23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:08.374711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ba17794-f800-4dc3-a479-0301c99bfa23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:08.375241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ba17794-f800-4dc3-a479-0301c99bfa23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:08.376073 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ba17794-f800-4dc3-a479-0301c99bfa23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:08.376570 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8ba17794-f800-4dc3-a479-0301c99bfa23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:08.498300 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8ba17794-f800-4dc3-a479-0301c99bfa23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:08.508271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8ba17794-f800-4dc3-a479-0301c99bfa23 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147102 Apr 19 04:01:08.508895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 827/1605] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:08 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:09.526100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-82e7a3cf-7c78-4bc0-bfae-f1646a154fc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:09.526773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-82e7a3cf-7c78-4bc0-bfae-f1646a154fc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:09.546579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82e7a3cf-7c78-4bc0-bfae-f1646a154fc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:09.547082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82e7a3cf-7c78-4bc0-bfae-f1646a154fc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:09.547948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82e7a3cf-7c78-4bc0-bfae-f1646a154fc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:09.548566 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-82e7a3cf-7c78-4bc0-bfae-f1646a154fc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:09.602967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43612. Apr 19 04:01:09.676159 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-82e7a3cf-7c78-4bc0-bfae-f1646a154fc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:09.686580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-82e7a3cf-7c78-4bc0-bfae-f1646a154fc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.163999 Apr 19 04:01:09.687429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 779/1606] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:09 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:10.704593 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4753a822-f25d-4fcd-bbc9-40937b078f31 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:10.705271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4753a822-f25d-4fcd-bbc9-40937b078f31 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:10.713052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4753a822-f25d-4fcd-bbc9-40937b078f31 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:10.713554 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4753a822-f25d-4fcd-bbc9-40937b078f31 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:10.714375 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4753a822-f25d-4fcd-bbc9-40937b078f31 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:10.714860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4753a822-f25d-4fcd-bbc9-40937b078f31 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:10.836607 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4753a822-f25d-4fcd-bbc9-40937b078f31 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:10.847092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4753a822-f25d-4fcd-bbc9-40937b078f31 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146609 Apr 19 04:01:10.847723 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 828/1607] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:10 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:11.865098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7c6535cd-b05d-46b0-9568-51aaed97cf14 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:11.865773 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7c6535cd-b05d-46b0-9568-51aaed97cf14 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:11.874501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c6535cd-b05d-46b0-9568-51aaed97cf14 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:11.875006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c6535cd-b05d-46b0-9568-51aaed97cf14 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:11.875890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c6535cd-b05d-46b0-9568-51aaed97cf14 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:11.876382 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c6535cd-b05d-46b0-9568-51aaed97cf14 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:12.001393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7c6535cd-b05d-46b0-9568-51aaed97cf14 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:12.011251 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7c6535cd-b05d-46b0-9568-51aaed97cf14 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150293 Apr 19 04:01:12.011872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 780/1608] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:11 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:13.029384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5c9e34f2-ac75-4370-ad63-b53ddb909050 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:13.037835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5c9e34f2-ac75-4370-ad63-b53ddb909050 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:13.037835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9e34f2-ac75-4370-ad63-b53ddb909050 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:13.038503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9e34f2-ac75-4370-ad63-b53ddb909050 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:13.039369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9e34f2-ac75-4370-ad63-b53ddb909050 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:13.039861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c9e34f2-ac75-4370-ad63-b53ddb909050 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:13.167197 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5c9e34f2-ac75-4370-ad63-b53ddb909050 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:13.177057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5c9e34f2-ac75-4370-ad63-b53ddb909050 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151832 Apr 19 04:01:13.177688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 829/1609] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:13 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:14.194820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-209a1e5d-040e-4027-be97-aa5194e9ad93 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:14.195521 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-209a1e5d-040e-4027-be97-aa5194e9ad93 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:14.203488 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-209a1e5d-040e-4027-be97-aa5194e9ad93 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:14.203999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-209a1e5d-040e-4027-be97-aa5194e9ad93 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:14.204863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-209a1e5d-040e-4027-be97-aa5194e9ad93 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:14.205353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-209a1e5d-040e-4027-be97-aa5194e9ad93 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:14.326882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-209a1e5d-040e-4027-be97-aa5194e9ad93 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:14.337006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-209a1e5d-040e-4027-be97-aa5194e9ad93 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146379 Apr 19 04:01:14.337622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 781/1610] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:14 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:15.354999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-44598b55-1e67-4d79-bacb-c5f9bb961e40 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:15.355650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-44598b55-1e67-4d79-bacb-c5f9bb961e40 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:15.363609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44598b55-1e67-4d79-bacb-c5f9bb961e40 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:15.364112 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44598b55-1e67-4d79-bacb-c5f9bb961e40 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:15.364936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44598b55-1e67-4d79-bacb-c5f9bb961e40 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:15.365427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-44598b55-1e67-4d79-bacb-c5f9bb961e40 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:15.487465 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-44598b55-1e67-4d79-bacb-c5f9bb961e40 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:15.497587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-44598b55-1e67-4d79-bacb-c5f9bb961e40 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146520 Apr 19 04:01:15.498729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 830/1611] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:15 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 04:01:16.516794 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7183480-1bc7-499a-bccc-c5de57b07215 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:16.517458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b7183480-1bc7-499a-bccc-c5de57b07215 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:16.525284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7183480-1bc7-499a-bccc-c5de57b07215 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:16.525785 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7183480-1bc7-499a-bccc-c5de57b07215 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:16.526606 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7183480-1bc7-499a-bccc-c5de57b07215 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:16.527089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7183480-1bc7-499a-bccc-c5de57b07215 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:16.652385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b7183480-1bc7-499a-bccc-c5de57b07215 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:16.662849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b7183480-1bc7-499a-bccc-c5de57b07215 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150892 Apr 19 04:01:16.663490 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 782/1612] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:16 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:17.680976 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4cba3f79-c9ed-4a9f-bdd2-215ec7f3fad9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:17.681650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4cba3f79-c9ed-4a9f-bdd2-215ec7f3fad9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:17.689509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4cba3f79-c9ed-4a9f-bdd2-215ec7f3fad9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:17.690012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4cba3f79-c9ed-4a9f-bdd2-215ec7f3fad9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:17.690840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4cba3f79-c9ed-4a9f-bdd2-215ec7f3fad9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:17.691395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4cba3f79-c9ed-4a9f-bdd2-215ec7f3fad9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:17.814241 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4cba3f79-c9ed-4a9f-bdd2-215ec7f3fad9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:17.824128 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4cba3f79-c9ed-4a9f-bdd2-215ec7f3fad9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147285 Apr 19 04:01:17.824748 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 831/1613] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:17 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:18.842671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-75b9da06-d120-4f23-914d-a78cd4f035b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:18.843370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-75b9da06-d120-4f23-914d-a78cd4f035b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:18.851236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75b9da06-d120-4f23-914d-a78cd4f035b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:18.851701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75b9da06-d120-4f23-914d-a78cd4f035b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:18.852530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75b9da06-d120-4f23-914d-a78cd4f035b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:18.853014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-75b9da06-d120-4f23-914d-a78cd4f035b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:18.978618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-75b9da06-d120-4f23-914d-a78cd4f035b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:18.989205 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-75b9da06-d120-4f23-914d-a78cd4f035b7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150743 Apr 19 04:01:18.989812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 783/1614] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:18 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:20.007176 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5cb590e3-ba58-469f-b851-8ca4313f9129 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:20.007862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5cb590e3-ba58-469f-b851-8ca4313f9129 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:20.016532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cb590e3-ba58-469f-b851-8ca4313f9129 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:20.017031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cb590e3-ba58-469f-b851-8ca4313f9129 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:20.017850 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cb590e3-ba58-469f-b851-8ca4313f9129 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:20.018330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cb590e3-ba58-469f-b851-8ca4313f9129 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:20.146031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5cb590e3-ba58-469f-b851-8ca4313f9129 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:20.156090 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5cb590e3-ba58-469f-b851-8ca4313f9129 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.153063 Apr 19 04:01:20.156744 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 832/1615] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:20 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:21.174107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8e7339e5-bf17-4d4d-a155-c244aeacd9b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:21.174776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8e7339e5-bf17-4d4d-a155-c244aeacd9b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:21.182633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e7339e5-bf17-4d4d-a155-c244aeacd9b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:21.183157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e7339e5-bf17-4d4d-a155-c244aeacd9b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:21.184023 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e7339e5-bf17-4d4d-a155-c244aeacd9b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:21.184513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e7339e5-bf17-4d4d-a155-c244aeacd9b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:21.307897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8e7339e5-bf17-4d4d-a155-c244aeacd9b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:21.318333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8e7339e5-bf17-4d4d-a155-c244aeacd9b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148422 Apr 19 04:01:21.318951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 784/1616] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:21 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:22.337170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a5482eab-ed73-479e-96e7-9d10eeb93f92 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:22.337909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a5482eab-ed73-479e-96e7-9d10eeb93f92 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:22.346616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5482eab-ed73-479e-96e7-9d10eeb93f92 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:22.347228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5482eab-ed73-479e-96e7-9d10eeb93f92 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:22.348063 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5482eab-ed73-479e-96e7-9d10eeb93f92 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:22.348556 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a5482eab-ed73-479e-96e7-9d10eeb93f92 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:22.478113 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a5482eab-ed73-479e-96e7-9d10eeb93f92 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:22.488292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a5482eab-ed73-479e-96e7-9d10eeb93f92 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.155145 Apr 19 04:01:22.488909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 833/1617] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:22 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:23.512179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7734bbbb-c21c-4bbb-96f0-37067580e21d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:23.512853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7734bbbb-c21c-4bbb-96f0-37067580e21d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:23.521285 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7734bbbb-c21c-4bbb-96f0-37067580e21d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:23.521789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7734bbbb-c21c-4bbb-96f0-37067580e21d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:23.522615 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7734bbbb-c21c-4bbb-96f0-37067580e21d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:23.523098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7734bbbb-c21c-4bbb-96f0-37067580e21d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:23.650024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7734bbbb-c21c-4bbb-96f0-37067580e21d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:23.659920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7734bbbb-c21c-4bbb-96f0-37067580e21d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151827 Apr 19 04:01:23.660530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 785/1618] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:23 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:24.674265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] AMQP server on 10.222.0.25:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 19 04:01:24.677843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f5d7a2c6-d7f0-404f-bf95-ccaf9d9d6577 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:24.678508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f5d7a2c6-d7f0-404f-bf95-ccaf9d9d6577 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:24.686313 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5d7a2c6-d7f0-404f-bf95-ccaf9d9d6577 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:24.686811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5d7a2c6-d7f0-404f-bf95-ccaf9d9d6577 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:24.687662 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5d7a2c6-d7f0-404f-bf95-ccaf9d9d6577 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:24.688156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f5d7a2c6-d7f0-404f-bf95-ccaf9d9d6577 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:24.809868 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f5d7a2c6-d7f0-404f-bf95-ccaf9d9d6577 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:24.819922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f5d7a2c6-d7f0-404f-bf95-ccaf9d9d6577 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146846 Apr 19 04:01:24.820540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 834/1619] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:24 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:25.838252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cd1ad1f7-b73d-48d2-a2af-6d5e8c96ebfa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:25.838928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cd1ad1f7-b73d-48d2-a2af-6d5e8c96ebfa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:25.847510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd1ad1f7-b73d-48d2-a2af-6d5e8c96ebfa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:25.847975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd1ad1f7-b73d-48d2-a2af-6d5e8c96ebfa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:25.848810 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd1ad1f7-b73d-48d2-a2af-6d5e8c96ebfa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:25.849305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cd1ad1f7-b73d-48d2-a2af-6d5e8c96ebfa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:25.974584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cd1ad1f7-b73d-48d2-a2af-6d5e8c96ebfa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:25.985110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cd1ad1f7-b73d-48d2-a2af-6d5e8c96ebfa tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150938 Apr 19 04:01:25.985711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 786/1620] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:25 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:27.002633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6dcf6e66-5d5f-498e-80c2-33820e1a9942 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:27.003326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6dcf6e66-5d5f-498e-80c2-33820e1a9942 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:27.023456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6dcf6e66-5d5f-498e-80c2-33820e1a9942 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:27.023973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6dcf6e66-5d5f-498e-80c2-33820e1a9942 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:27.024823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6dcf6e66-5d5f-498e-80c2-33820e1a9942 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:27.025316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6dcf6e66-5d5f-498e-80c2-33820e1a9942 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:27.086589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43708. Apr 19 04:01:27.155058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:01:27.155271 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:01:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:01:27.155586 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6dcf6e66-5d5f-498e-80c2-33820e1a9942 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:27.165495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6dcf6e66-5d5f-498e-80c2-33820e1a9942 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.167011 Apr 19 04:01:27.166125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 835/1621] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:26 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:28.183729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fc4cc1e6-fc21-4b1e-b7ae-42783ead4c8c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:28.184408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fc4cc1e6-fc21-4b1e-b7ae-42783ead4c8c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:28.192247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc4cc1e6-fc21-4b1e-b7ae-42783ead4c8c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:28.192759 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc4cc1e6-fc21-4b1e-b7ae-42783ead4c8c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:28.193600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc4cc1e6-fc21-4b1e-b7ae-42783ead4c8c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:28.194095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fc4cc1e6-fc21-4b1e-b7ae-42783ead4c8c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:28.316544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fc4cc1e6-fc21-4b1e-b7ae-42783ead4c8c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:28.326840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fc4cc1e6-fc21-4b1e-b7ae-42783ead4c8c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147436 Apr 19 04:01:28.327486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 787/1622] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:28 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 04:01:29.344788 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-58c7c81a-d592-496e-a0c0-c454339a2eea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:29.345456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-58c7c81a-d592-496e-a0c0-c454339a2eea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:29.353332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-58c7c81a-d592-496e-a0c0-c454339a2eea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:29.353836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-58c7c81a-d592-496e-a0c0-c454339a2eea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:29.354661 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-58c7c81a-d592-496e-a0c0-c454339a2eea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:29.355172 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-58c7c81a-d592-496e-a0c0-c454339a2eea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:29.479102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-58c7c81a-d592-496e-a0c0-c454339a2eea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:29.489497 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-58c7c81a-d592-496e-a0c0-c454339a2eea tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148854 Apr 19 04:01:29.490111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 836/1623] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:29 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:30.507872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-a4c8f569-00c6-4ef6-bd03-533eeaafb042 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:30.508545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-a4c8f569-00c6-4ef6-bd03-533eeaafb042 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:30.516997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4c8f569-00c6-4ef6-bd03-533eeaafb042 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:30.517503 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4c8f569-00c6-4ef6-bd03-533eeaafb042 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:30.518331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4c8f569-00c6-4ef6-bd03-533eeaafb042 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:30.518825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-a4c8f569-00c6-4ef6-bd03-533eeaafb042 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:30.645945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-a4c8f569-00c6-4ef6-bd03-533eeaafb042 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:30.655837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-a4c8f569-00c6-4ef6-bd03-533eeaafb042 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152074 Apr 19 04:01:30.656451 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 788/1624] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:30 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:31.673733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-700ff1c2-931b-42df-9994-92fe3c65d267 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:31.674410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-700ff1c2-931b-42df-9994-92fe3c65d267 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:31.682256 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-700ff1c2-931b-42df-9994-92fe3c65d267 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:31.682764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-700ff1c2-931b-42df-9994-92fe3c65d267 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:31.683625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-700ff1c2-931b-42df-9994-92fe3c65d267 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:31.684120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-700ff1c2-931b-42df-9994-92fe3c65d267 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:31.806586 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-700ff1c2-931b-42df-9994-92fe3c65d267 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:31.816421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-700ff1c2-931b-42df-9994-92fe3c65d267 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147364 Apr 19 04:01:31.817034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 837/1625] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:31 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:32.834319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e96207d1-e79b-4fda-ba4c-ca4711a19eda tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:32.834991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e96207d1-e79b-4fda-ba4c-ca4711a19eda tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:32.842830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e96207d1-e79b-4fda-ba4c-ca4711a19eda tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:32.843421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e96207d1-e79b-4fda-ba4c-ca4711a19eda tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:32.844195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e96207d1-e79b-4fda-ba4c-ca4711a19eda tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:32.844682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e96207d1-e79b-4fda-ba4c-ca4711a19eda tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:32.969270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e96207d1-e79b-4fda-ba4c-ca4711a19eda tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:32.979053 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e96207d1-e79b-4fda-ba4c-ca4711a19eda tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148825 Apr 19 04:01:32.979696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 789/1626] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:32 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:33.998358 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-84fce684-4469-4cae-93ec-b713c69c3f11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:33.999042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-84fce684-4469-4cae-93ec-b713c69c3f11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:34.007036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84fce684-4469-4cae-93ec-b713c69c3f11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:34.007580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84fce684-4469-4cae-93ec-b713c69c3f11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:34.008414 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84fce684-4469-4cae-93ec-b713c69c3f11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:34.008913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-84fce684-4469-4cae-93ec-b713c69c3f11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:34.275882 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-84fce684-4469-4cae-93ec-b713c69c3f11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:34.285742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-84fce684-4469-4cae-93ec-b713c69c3f11 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.292266 Apr 19 04:01:34.286352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 838/1627] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:33 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:35.303713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-361f035d-7f6b-46b3-b72b-f94d09f92756 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:35.304370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-361f035d-7f6b-46b3-b72b-f94d09f92756 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:35.312385 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-361f035d-7f6b-46b3-b72b-f94d09f92756 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:35.312890 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-361f035d-7f6b-46b3-b72b-f94d09f92756 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:35.313709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-361f035d-7f6b-46b3-b72b-f94d09f92756 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:35.314194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-361f035d-7f6b-46b3-b72b-f94d09f92756 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:35.436995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-361f035d-7f6b-46b3-b72b-f94d09f92756 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:35.446718 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-361f035d-7f6b-46b3-b72b-f94d09f92756 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147168 Apr 19 04:01:35.447357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 790/1628] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:35 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:36.464133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-36c68865-d9a1-4444-8d8d-8adc7169304d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:36.464804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-36c68865-d9a1-4444-8d8d-8adc7169304d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:36.473210 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36c68865-d9a1-4444-8d8d-8adc7169304d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:36.473713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36c68865-d9a1-4444-8d8d-8adc7169304d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:36.474541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36c68865-d9a1-4444-8d8d-8adc7169304d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:36.475034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-36c68865-d9a1-4444-8d8d-8adc7169304d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:36.599134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-36c68865-d9a1-4444-8d8d-8adc7169304d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:36.609495 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-36c68865-d9a1-4444-8d8d-8adc7169304d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149302 Apr 19 04:01:36.610091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 839/1629] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:36 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:37.627649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cac97314-6927-4b4e-a547-31914ba36de5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:37.628387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cac97314-6927-4b4e-a547-31914ba36de5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:37.636280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cac97314-6927-4b4e-a547-31914ba36de5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:37.636781 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cac97314-6927-4b4e-a547-31914ba36de5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:37.637605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cac97314-6927-4b4e-a547-31914ba36de5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:37.638092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cac97314-6927-4b4e-a547-31914ba36de5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:37.765275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cac97314-6927-4b4e-a547-31914ba36de5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:37.775301 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cac97314-6927-4b4e-a547-31914ba36de5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152663 Apr 19 04:01:37.775920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 791/1630] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:37 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:38.793747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6f7ad0c7-f4cc-426e-a7c3-2292932d6d20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:38.794426 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6f7ad0c7-f4cc-426e-a7c3-2292932d6d20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:38.802542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f7ad0c7-f4cc-426e-a7c3-2292932d6d20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:38.803057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f7ad0c7-f4cc-426e-a7c3-2292932d6d20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:38.803922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f7ad0c7-f4cc-426e-a7c3-2292932d6d20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:38.804417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f7ad0c7-f4cc-426e-a7c3-2292932d6d20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:38.933737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6f7ad0c7-f4cc-426e-a7c3-2292932d6d20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:38.944541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6f7ad0c7-f4cc-426e-a7c3-2292932d6d20 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.154856 Apr 19 04:01:38.945152 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 840/1631] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:38 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:39.961950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c6287887-2b93-40a2-8492-1b6b1d4d1c41 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:39.962617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c6287887-2b93-40a2-8492-1b6b1d4d1c41 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:39.970886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c6287887-2b93-40a2-8492-1b6b1d4d1c41 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:39.971424 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c6287887-2b93-40a2-8492-1b6b1d4d1c41 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:39.972247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c6287887-2b93-40a2-8492-1b6b1d4d1c41 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:39.972737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c6287887-2b93-40a2-8492-1b6b1d4d1c41 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:40.098993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c6287887-2b93-40a2-8492-1b6b1d4d1c41 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:40.109529 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c6287887-2b93-40a2-8492-1b6b1d4d1c41 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151619 Apr 19 04:01:40.110147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 792/1632] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:39 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:41.127993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-405b19fd-fcef-4f94-90e2-6237996931ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:41.128666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-405b19fd-fcef-4f94-90e2-6237996931ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:41.136483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-405b19fd-fcef-4f94-90e2-6237996931ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:41.136996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-405b19fd-fcef-4f94-90e2-6237996931ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:41.137830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-405b19fd-fcef-4f94-90e2-6237996931ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:41.138318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-405b19fd-fcef-4f94-90e2-6237996931ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:41.266162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-405b19fd-fcef-4f94-90e2-6237996931ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:41.276640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-405b19fd-fcef-4f94-90e2-6237996931ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152680 Apr 19 04:01:41.277247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 841/1633] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:41 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:42.294487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-86eb9e3d-341b-4ca7-ace7-dadb0153ca77 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:42.295098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-86eb9e3d-341b-4ca7-ace7-dadb0153ca77 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:42.302980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86eb9e3d-341b-4ca7-ace7-dadb0153ca77 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:42.303538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86eb9e3d-341b-4ca7-ace7-dadb0153ca77 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:42.304363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86eb9e3d-341b-4ca7-ace7-dadb0153ca77 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:42.304851 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-86eb9e3d-341b-4ca7-ace7-dadb0153ca77 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:42.426580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-86eb9e3d-341b-4ca7-ace7-dadb0153ca77 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:42.436874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-86eb9e3d-341b-4ca7-ace7-dadb0153ca77 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146516 Apr 19 04:01:42.437483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 793/1634] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:42 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:43.243381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:01:43.243560 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:01:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:01:43.455102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0a7a797b-fcb0-4ecf-8fcc-29114160585a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:43.455799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0a7a797b-fcb0-4ecf-8fcc-29114160585a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:43.463628 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a7a797b-fcb0-4ecf-8fcc-29114160585a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:43.464130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a7a797b-fcb0-4ecf-8fcc-29114160585a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:43.464951 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a7a797b-fcb0-4ecf-8fcc-29114160585a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:43.465437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a7a797b-fcb0-4ecf-8fcc-29114160585a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:43.588444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0a7a797b-fcb0-4ecf-8fcc-29114160585a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:43.599297 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0a7a797b-fcb0-4ecf-8fcc-29114160585a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148205 Apr 19 04:01:43.599922 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 842/1635] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:43 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:44.617140 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2556d87d-3530-4ddd-85af-6c24971bd3d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:44.617820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2556d87d-3530-4ddd-85af-6c24971bd3d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:44.625974 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2556d87d-3530-4ddd-85af-6c24971bd3d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:44.626487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2556d87d-3530-4ddd-85af-6c24971bd3d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:44.627357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2556d87d-3530-4ddd-85af-6c24971bd3d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:44.627853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2556d87d-3530-4ddd-85af-6c24971bd3d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:44.757709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2556d87d-3530-4ddd-85af-6c24971bd3d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:44.768168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2556d87d-3530-4ddd-85af-6c24971bd3d3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.155058 Apr 19 04:01:44.768802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 794/1636] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:44 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:45.786891 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bac52263-be04-4b62-bc35-ca9c324a3e55 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:45.787583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bac52263-be04-4b62-bc35-ca9c324a3e55 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:45.795898 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bac52263-be04-4b62-bc35-ca9c324a3e55 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:45.796400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bac52263-be04-4b62-bc35-ca9c324a3e55 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:45.797218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bac52263-be04-4b62-bc35-ca9c324a3e55 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:45.797704 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bac52263-be04-4b62-bc35-ca9c324a3e55 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:45.918296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bac52263-be04-4b62-bc35-ca9c324a3e55 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:45.928487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bac52263-be04-4b62-bc35-ca9c324a3e55 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.145788 Apr 19 04:01:45.929091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 843/1637] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:45 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:46.946260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-247b50cc-c6af-4a81-a40b-4de929ba8e18 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:46.946926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-247b50cc-c6af-4a81-a40b-4de929ba8e18 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:46.955491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-247b50cc-c6af-4a81-a40b-4de929ba8e18 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:46.955994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-247b50cc-c6af-4a81-a40b-4de929ba8e18 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:46.956814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-247b50cc-c6af-4a81-a40b-4de929ba8e18 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:46.957299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-247b50cc-c6af-4a81-a40b-4de929ba8e18 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:47.082317 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-247b50cc-c6af-4a81-a40b-4de929ba8e18 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:47.092084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-247b50cc-c6af-4a81-a40b-4de929ba8e18 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149919 Apr 19 04:01:47.092750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 795/1638] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:46 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:48.110469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7878704a-8486-47d0-b13a-338d65077cc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:48.111130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7878704a-8486-47d0-b13a-338d65077cc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:48.118862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7878704a-8486-47d0-b13a-338d65077cc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:48.119413 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7878704a-8486-47d0-b13a-338d65077cc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:48.120236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7878704a-8486-47d0-b13a-338d65077cc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:48.120722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7878704a-8486-47d0-b13a-338d65077cc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:48.248181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7878704a-8486-47d0-b13a-338d65077cc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:48.258024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7878704a-8486-47d0-b13a-338d65077cc1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151764 Apr 19 04:01:48.258631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 844/1639] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:48 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:49.276378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f2431c3e-db42-4162-bde7-7778acb97da8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:49.277089 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f2431c3e-db42-4162-bde7-7778acb97da8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:49.285474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2431c3e-db42-4162-bde7-7778acb97da8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:49.285971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2431c3e-db42-4162-bde7-7778acb97da8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:49.286792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2431c3e-db42-4162-bde7-7778acb97da8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:49.287307 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f2431c3e-db42-4162-bde7-7778acb97da8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:49.409932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f2431c3e-db42-4162-bde7-7778acb97da8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:49.419706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f2431c3e-db42-4162-bde7-7778acb97da8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147489 Apr 19 04:01:49.420310 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 796/1640] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:49 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:50.279687 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:01:50.280179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:01:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:01:50.437644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-dd9dafaa-8d6a-4d7c-a6a8-2807115c1117 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:50.438320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-dd9dafaa-8d6a-4d7c-a6a8-2807115c1117 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:50.446091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd9dafaa-8d6a-4d7c-a6a8-2807115c1117 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:50.446598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd9dafaa-8d6a-4d7c-a6a8-2807115c1117 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:50.447460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd9dafaa-8d6a-4d7c-a6a8-2807115c1117 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:50.447962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-dd9dafaa-8d6a-4d7c-a6a8-2807115c1117 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:50.570772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-dd9dafaa-8d6a-4d7c-a6a8-2807115c1117 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:50.580944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-dd9dafaa-8d6a-4d7c-a6a8-2807115c1117 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147960 Apr 19 04:01:50.581782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 845/1641] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:50 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:51.599207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2f47c8ca-658d-4e11-b045-b998c1170d6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:51.599884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2f47c8ca-658d-4e11-b045-b998c1170d6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:51.608258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f47c8ca-658d-4e11-b045-b998c1170d6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:51.608765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f47c8ca-658d-4e11-b045-b998c1170d6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:51.609589 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f47c8ca-658d-4e11-b045-b998c1170d6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:51.610079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2f47c8ca-658d-4e11-b045-b998c1170d6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:51.964761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2f47c8ca-658d-4e11-b045-b998c1170d6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:51.976173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2f47c8ca-658d-4e11-b045-b998c1170d6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.381022 Apr 19 04:01:51.976799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 797/1642] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:51 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:52.994068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d2fa6687-ed74-40b6-8538-3914a7e3a04b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:52.994843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d2fa6687-ed74-40b6-8538-3914a7e3a04b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:53.003591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2fa6687-ed74-40b6-8538-3914a7e3a04b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:53.004108 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2fa6687-ed74-40b6-8538-3914a7e3a04b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:53.004940 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2fa6687-ed74-40b6-8538-3914a7e3a04b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:53.005427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d2fa6687-ed74-40b6-8538-3914a7e3a04b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:53.130354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d2fa6687-ed74-40b6-8538-3914a7e3a04b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:53.140363 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d2fa6687-ed74-40b6-8538-3914a7e3a04b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150449 Apr 19 04:01:53.140986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 846/1643] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:52 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:54.158781 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-21ab3122-3695-466f-9dc8-94f439b26ef9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:54.159513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-21ab3122-3695-466f-9dc8-94f439b26ef9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:54.167354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21ab3122-3695-466f-9dc8-94f439b26ef9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:54.167861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21ab3122-3695-466f-9dc8-94f439b26ef9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:54.168696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21ab3122-3695-466f-9dc8-94f439b26ef9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:54.169184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-21ab3122-3695-466f-9dc8-94f439b26ef9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:54.294572 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-21ab3122-3695-466f-9dc8-94f439b26ef9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:54.304513 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-21ab3122-3695-466f-9dc8-94f439b26ef9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149948 Apr 19 04:01:54.305126 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 798/1644] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:54 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:55.323046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e380d757-f0ac-459b-969c-3c4a5dcf78d6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:55.323783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e380d757-f0ac-459b-969c-3c4a5dcf78d6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:55.332579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e380d757-f0ac-459b-969c-3c4a5dcf78d6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:55.333094 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e380d757-f0ac-459b-969c-3c4a5dcf78d6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:55.333931 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e380d757-f0ac-459b-969c-3c4a5dcf78d6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:55.334429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e380d757-f0ac-459b-969c-3c4a5dcf78d6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:55.462456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e380d757-f0ac-459b-969c-3c4a5dcf78d6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:55.472994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e380d757-f0ac-459b-969c-3c4a5dcf78d6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.154105 Apr 19 04:01:55.473618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 847/1645] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:55 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:56.490705 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fcfe185f-3845-4770-9703-58f1e3a15406 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:56.491408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fcfe185f-3845-4770-9703-58f1e3a15406 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:56.499476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fcfe185f-3845-4770-9703-58f1e3a15406 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:56.499978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fcfe185f-3845-4770-9703-58f1e3a15406 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:56.500797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fcfe185f-3845-4770-9703-58f1e3a15406 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:56.501282 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fcfe185f-3845-4770-9703-58f1e3a15406 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:56.623466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fcfe185f-3845-4770-9703-58f1e3a15406 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:56.633565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fcfe185f-3845-4770-9703-58f1e3a15406 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146875 Apr 19 04:01:56.634181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 799/1646] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:56 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:57.651619 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d5ac1e13-c00c-4fa8-8328-cb435d449627 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:57.652230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d5ac1e13-c00c-4fa8-8328-cb435d449627 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:57.659988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5ac1e13-c00c-4fa8-8328-cb435d449627 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:57.660486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5ac1e13-c00c-4fa8-8328-cb435d449627 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:57.661305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5ac1e13-c00c-4fa8-8328-cb435d449627 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:57.661787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d5ac1e13-c00c-4fa8-8328-cb435d449627 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:57.784110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d5ac1e13-c00c-4fa8-8328-cb435d449627 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:57.794394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d5ac1e13-c00c-4fa8-8328-cb435d449627 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146952 Apr 19 04:01:57.795002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 848/1647] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:57 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:58.812886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3a1e9724-eb28-4419-9c86-7410939aead8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:58.813492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3a1e9724-eb28-4419-9c86-7410939aead8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:58.821398 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a1e9724-eb28-4419-9c86-7410939aead8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:58.821905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a1e9724-eb28-4419-9c86-7410939aead8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:58.822738 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a1e9724-eb28-4419-9c86-7410939aead8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:58.823257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3a1e9724-eb28-4419-9c86-7410939aead8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:58.946533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3a1e9724-eb28-4419-9c86-7410939aead8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:01:58.957315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3a1e9724-eb28-4419-9c86-7410939aead8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149139 Apr 19 04:01:58.957932 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 800/1648] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:58 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:01:59.975534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-f899f033-3b22-4f2e-a10b-21b25d6b56b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:01:59.976203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-f899f033-3b22-4f2e-a10b-21b25d6b56b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:01:59.984031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f899f033-3b22-4f2e-a10b-21b25d6b56b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:59.984520 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f899f033-3b22-4f2e-a10b-21b25d6b56b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:01:59.985341 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f899f033-3b22-4f2e-a10b-21b25d6b56b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:01:59.985829 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-f899f033-3b22-4f2e-a10b-21b25d6b56b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:00.107060 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-f899f033-3b22-4f2e-a10b-21b25d6b56b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:00.116781 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-f899f033-3b22-4f2e-a10b-21b25d6b56b4 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.145542 Apr 19 04:02:00.117396 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 849/1649] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:01:59 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:01.134918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4a491f3f-8b04-4a60-b01c-4f8bafcfe723 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:01.135655 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4a491f3f-8b04-4a60-b01c-4f8bafcfe723 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:01.143444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a491f3f-8b04-4a60-b01c-4f8bafcfe723 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:01.143949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a491f3f-8b04-4a60-b01c-4f8bafcfe723 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:01.144793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a491f3f-8b04-4a60-b01c-4f8bafcfe723 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:01.145253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4a491f3f-8b04-4a60-b01c-4f8bafcfe723 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:01.268786 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4a491f3f-8b04-4a60-b01c-4f8bafcfe723 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:01.279551 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4a491f3f-8b04-4a60-b01c-4f8bafcfe723 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148679 Apr 19 04:02:01.280165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 801/1650] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:01 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:02.298399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-93db0aea-b14d-4140-9e4e-6fe43a2e16c0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:02.299070 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-93db0aea-b14d-4140-9e4e-6fe43a2e16c0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:02.306855 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93db0aea-b14d-4140-9e4e-6fe43a2e16c0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:02.307397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93db0aea-b14d-4140-9e4e-6fe43a2e16c0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:02.308232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93db0aea-b14d-4140-9e4e-6fe43a2e16c0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:02.309322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-93db0aea-b14d-4140-9e4e-6fe43a2e16c0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:02.437764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-93db0aea-b14d-4140-9e4e-6fe43a2e16c0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:02.447543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-93db0aea-b14d-4140-9e4e-6fe43a2e16c0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.153290 Apr 19 04:02:02.448156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 850/1651] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:02 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:03.465352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-aca1cead-61fb-4fe2-843b-437d58c9dcd6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:03.466016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-aca1cead-61fb-4fe2-843b-437d58c9dcd6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:03.473764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aca1cead-61fb-4fe2-843b-437d58c9dcd6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:03.474264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aca1cead-61fb-4fe2-843b-437d58c9dcd6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:03.475085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aca1cead-61fb-4fe2-843b-437d58c9dcd6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:03.475618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-aca1cead-61fb-4fe2-843b-437d58c9dcd6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:03.597879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-aca1cead-61fb-4fe2-843b-437d58c9dcd6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:03.608319 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-aca1cead-61fb-4fe2-843b-437d58c9dcd6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147074 Apr 19 04:02:03.608933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 802/1652] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:03 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:04.626710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0cf574e6-1b37-417d-86c3-ae073c9e84c7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:04.627430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0cf574e6-1b37-417d-86c3-ae073c9e84c7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:04.635352 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cf574e6-1b37-417d-86c3-ae073c9e84c7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:04.635866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cf574e6-1b37-417d-86c3-ae073c9e84c7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:04.636698 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cf574e6-1b37-417d-86c3-ae073c9e84c7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:04.637696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0cf574e6-1b37-417d-86c3-ae073c9e84c7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:04.760252 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0cf574e6-1b37-417d-86c3-ae073c9e84c7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:04.770676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0cf574e6-1b37-417d-86c3-ae073c9e84c7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148590 Apr 19 04:02:04.771316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 851/1653] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:04 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:05.788727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-12fde1c6-9709-48b5-b51c-f928c7c7879d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:05.789402 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-12fde1c6-9709-48b5-b51c-f928c7c7879d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:05.797981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12fde1c6-9709-48b5-b51c-f928c7c7879d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:05.798486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12fde1c6-9709-48b5-b51c-f928c7c7879d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:05.799360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12fde1c6-9709-48b5-b51c-f928c7c7879d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:05.799846 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-12fde1c6-9709-48b5-b51c-f928c7c7879d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:05.922892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-12fde1c6-9709-48b5-b51c-f928c7c7879d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:05.932713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-12fde1c6-9709-48b5-b51c-f928c7c7879d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148151 Apr 19 04:02:05.933324 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 803/1654] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:05 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:06.951286 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2da1c9b5-7c11-4ddc-84ad-2df29488394f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:06.951961 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2da1c9b5-7c11-4ddc-84ad-2df29488394f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:06.959963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2da1c9b5-7c11-4ddc-84ad-2df29488394f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:06.960471 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2da1c9b5-7c11-4ddc-84ad-2df29488394f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:06.961302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2da1c9b5-7c11-4ddc-84ad-2df29488394f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:06.961800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2da1c9b5-7c11-4ddc-84ad-2df29488394f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:07.084411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2da1c9b5-7c11-4ddc-84ad-2df29488394f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:07.094633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2da1c9b5-7c11-4ddc-84ad-2df29488394f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148066 Apr 19 04:02:07.095281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 852/1655] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:06 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:08.113050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c78ec1c8-bfda-433c-9c6e-95c4e0f0dd29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:08.113713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c78ec1c8-bfda-433c-9c6e-95c4e0f0dd29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:08.122082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c78ec1c8-bfda-433c-9c6e-95c4e0f0dd29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:08.122821 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c78ec1c8-bfda-433c-9c6e-95c4e0f0dd29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:08.123671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c78ec1c8-bfda-433c-9c6e-95c4e0f0dd29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:08.124153 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c78ec1c8-bfda-433c-9c6e-95c4e0f0dd29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:08.247985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c78ec1c8-bfda-433c-9c6e-95c4e0f0dd29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:08.257697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c78ec1c8-bfda-433c-9c6e-95c4e0f0dd29 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148849 Apr 19 04:02:08.258303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 804/1656] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:08 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:09.275760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7c685286-e564-4603-b80c-3a7613d95d48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:09.276378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7c685286-e564-4603-b80c-3a7613d95d48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:09.284249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c685286-e564-4603-b80c-3a7613d95d48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:09.284754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c685286-e564-4603-b80c-3a7613d95d48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:09.285582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c685286-e564-4603-b80c-3a7613d95d48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:09.286071 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7c685286-e564-4603-b80c-3a7613d95d48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:09.413880 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7c685286-e564-4603-b80c-3a7613d95d48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:09.423927 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7c685286-e564-4603-b80c-3a7613d95d48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152438 Apr 19 04:02:09.424544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 853/1657] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:09 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:10.442420 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cdbe4729-d871-4102-bf1a-8c4d75790d83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:10.443093 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cdbe4729-d871-4102-bf1a-8c4d75790d83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:10.451696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdbe4729-d871-4102-bf1a-8c4d75790d83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:10.452209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdbe4729-d871-4102-bf1a-8c4d75790d83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:10.453043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdbe4729-d871-4102-bf1a-8c4d75790d83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:10.453537 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cdbe4729-d871-4102-bf1a-8c4d75790d83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:10.577335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cdbe4729-d871-4102-bf1a-8c4d75790d83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:10.587245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cdbe4729-d871-4102-bf1a-8c4d75790d83 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148864 Apr 19 04:02:10.589249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 805/1658] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:10 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:11.605854 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7577d1f1-8c1d-400e-b280-4b8c7454d18b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:11.606516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7577d1f1-8c1d-400e-b280-4b8c7454d18b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:11.614364 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7577d1f1-8c1d-400e-b280-4b8c7454d18b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:11.614861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7577d1f1-8c1d-400e-b280-4b8c7454d18b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:11.615711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7577d1f1-8c1d-400e-b280-4b8c7454d18b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:11.616198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7577d1f1-8c1d-400e-b280-4b8c7454d18b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:11.739547 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7577d1f1-8c1d-400e-b280-4b8c7454d18b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:11.750311 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7577d1f1-8c1d-400e-b280-4b8c7454d18b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148515 Apr 19 04:02:11.750936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 854/1659] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:11 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:12.767545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-19d60d2f-a24b-425c-b1b9-7901e63233da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:12.768266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-19d60d2f-a24b-425c-b1b9-7901e63233da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:12.776230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19d60d2f-a24b-425c-b1b9-7901e63233da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:12.776900 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19d60d2f-a24b-425c-b1b9-7901e63233da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:12.777752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19d60d2f-a24b-425c-b1b9-7901e63233da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:12.778237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19d60d2f-a24b-425c-b1b9-7901e63233da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:12.904052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-19d60d2f-a24b-425c-b1b9-7901e63233da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:12.914055 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-19d60d2f-a24b-425c-b1b9-7901e63233da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150683 Apr 19 04:02:12.914677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 806/1660] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:12 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:13.936186 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-38b8ec95-b658-4059-8386-56da81d52352 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:13.936835 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-38b8ec95-b658-4059-8386-56da81d52352 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:13.944913 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38b8ec95-b658-4059-8386-56da81d52352 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:13.945412 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38b8ec95-b658-4059-8386-56da81d52352 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:13.946249 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38b8ec95-b658-4059-8386-56da81d52352 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:13.946734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-38b8ec95-b658-4059-8386-56da81d52352 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:14.068783 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-38b8ec95-b658-4059-8386-56da81d52352 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:14.079078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-38b8ec95-b658-4059-8386-56da81d52352 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151117 Apr 19 04:02:14.079716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 855/1661] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:13 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:15.096925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9dad9642-1473-43e1-852a-bf7616cfae86 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:15.097600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9dad9642-1473-43e1-852a-bf7616cfae86 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:15.105896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9dad9642-1473-43e1-852a-bf7616cfae86 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:15.106493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9dad9642-1473-43e1-852a-bf7616cfae86 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:15.107345 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9dad9642-1473-43e1-852a-bf7616cfae86 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:15.107838 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9dad9642-1473-43e1-852a-bf7616cfae86 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:15.232103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9dad9642-1473-43e1-852a-bf7616cfae86 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:15.241879 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9dad9642-1473-43e1-852a-bf7616cfae86 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149015 Apr 19 04:02:15.242476 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 807/1662] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:15 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:16.260302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5e67b7fa-c9e0-440e-9c07-214646c0f0b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:16.260916 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5e67b7fa-c9e0-440e-9c07-214646c0f0b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:16.269367 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e67b7fa-c9e0-440e-9c07-214646c0f0b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:16.269870 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e67b7fa-c9e0-440e-9c07-214646c0f0b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:16.270691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e67b7fa-c9e0-440e-9c07-214646c0f0b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:16.271203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5e67b7fa-c9e0-440e-9c07-214646c0f0b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:16.399079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5e67b7fa-c9e0-440e-9c07-214646c0f0b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:16.409109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5e67b7fa-c9e0-440e-9c07-214646c0f0b9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152891 Apr 19 04:02:16.409732 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 856/1663] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:16 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:17.427578 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-910633d9-f534-4ac0-989c-330515db56b1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:17.428254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-910633d9-f534-4ac0-989c-330515db56b1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:17.436121 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-910633d9-f534-4ac0-989c-330515db56b1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:17.436632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-910633d9-f534-4ac0-989c-330515db56b1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:17.437472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-910633d9-f534-4ac0-989c-330515db56b1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:17.437965 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-910633d9-f534-4ac0-989c-330515db56b1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:17.561078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-910633d9-f534-4ac0-989c-330515db56b1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:17.571203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-910633d9-f534-4ac0-989c-330515db56b1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147782 Apr 19 04:02:17.571823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 808/1664] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:17 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:18.590682 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-cc3a5280-ddc6-4a89-8716-12fa240fcbc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:18.591394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-cc3a5280-ddc6-4a89-8716-12fa240fcbc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:18.599166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc3a5280-ddc6-4a89-8716-12fa240fcbc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:18.599684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc3a5280-ddc6-4a89-8716-12fa240fcbc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:18.600599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc3a5280-ddc6-4a89-8716-12fa240fcbc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:18.601082 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-cc3a5280-ddc6-4a89-8716-12fa240fcbc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:18.724548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-cc3a5280-ddc6-4a89-8716-12fa240fcbc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:18.734427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-cc3a5280-ddc6-4a89-8716-12fa240fcbc8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148867 Apr 19 04:02:18.735036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 857/1665] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:18 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:19.752463 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1ac30a5e-56da-49b5-aea4-78755b7d2b38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:19.753133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1ac30a5e-56da-49b5-aea4-78755b7d2b38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:19.760983 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ac30a5e-56da-49b5-aea4-78755b7d2b38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:19.761486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ac30a5e-56da-49b5-aea4-78755b7d2b38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:19.762306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ac30a5e-56da-49b5-aea4-78755b7d2b38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:19.762792 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ac30a5e-56da-49b5-aea4-78755b7d2b38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:19.886683 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1ac30a5e-56da-49b5-aea4-78755b7d2b38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:19.896561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1ac30a5e-56da-49b5-aea4-78755b7d2b38 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148384 Apr 19 04:02:19.897173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 809/1666] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:19 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:20.914014 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9a42bb2e-7968-469e-a167-b5ddfaba3eb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:20.914684 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9a42bb2e-7968-469e-a167-b5ddfaba3eb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:20.922509 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a42bb2e-7968-469e-a167-b5ddfaba3eb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:20.923009 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a42bb2e-7968-469e-a167-b5ddfaba3eb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:20.923860 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a42bb2e-7968-469e-a167-b5ddfaba3eb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:20.924350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9a42bb2e-7968-469e-a167-b5ddfaba3eb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:21.046993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9a42bb2e-7968-469e-a167-b5ddfaba3eb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:21.056790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9a42bb2e-7968-469e-a167-b5ddfaba3eb3 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146926 Apr 19 04:02:21.057400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 858/1667] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:20 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:22.075411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fd19ddca-1902-477f-a2e6-b999457cadef tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:22.076092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fd19ddca-1902-477f-a2e6-b999457cadef tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:22.083962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd19ddca-1902-477f-a2e6-b999457cadef tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:22.084472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd19ddca-1902-477f-a2e6-b999457cadef tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:22.085303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd19ddca-1902-477f-a2e6-b999457cadef tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:22.085797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fd19ddca-1902-477f-a2e6-b999457cadef tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:22.210166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fd19ddca-1902-477f-a2e6-b999457cadef tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:22.220017 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fd19ddca-1902-477f-a2e6-b999457cadef tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149486 Apr 19 04:02:22.220631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 810/1668] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:22 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:23.237897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7f39a34-e2c8-439c-90bb-4aafccb998a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:23.238563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b7f39a34-e2c8-439c-90bb-4aafccb998a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:23.246303 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7f39a34-e2c8-439c-90bb-4aafccb998a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:23.246762 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7f39a34-e2c8-439c-90bb-4aafccb998a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:23.247616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7f39a34-e2c8-439c-90bb-4aafccb998a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:23.248350 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7f39a34-e2c8-439c-90bb-4aafccb998a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:23.376930 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b7f39a34-e2c8-439c-90bb-4aafccb998a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:23.387302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b7f39a34-e2c8-439c-90bb-4aafccb998a6 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.153511 Apr 19 04:02:23.387914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 859/1669] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:23 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:24.405691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0a6f4479-0965-4c6a-9bf1-8b3d925703ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:24.406379 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0a6f4479-0965-4c6a-9bf1-8b3d925703ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:24.414313 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a6f4479-0965-4c6a-9bf1-8b3d925703ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:24.414817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a6f4479-0965-4c6a-9bf1-8b3d925703ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:24.415681 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a6f4479-0965-4c6a-9bf1-8b3d925703ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:24.416170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0a6f4479-0965-4c6a-9bf1-8b3d925703ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:24.538468 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0a6f4479-0965-4c6a-9bf1-8b3d925703ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:24.549218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0a6f4479-0965-4c6a-9bf1-8b3d925703ee tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148082 Apr 19 04:02:24.559169 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 811/1670] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:24 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:25.567666 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1c4b8199-d3ba-4d92-8035-84f4ff55539e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:25.568474 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1c4b8199-d3ba-4d92-8035-84f4ff55539e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:25.577080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c4b8199-d3ba-4d92-8035-84f4ff55539e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:25.577587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c4b8199-d3ba-4d92-8035-84f4ff55539e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:25.578417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c4b8199-d3ba-4d92-8035-84f4ff55539e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:25.578909 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1c4b8199-d3ba-4d92-8035-84f4ff55539e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:25.701558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1c4b8199-d3ba-4d92-8035-84f4ff55539e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:25.711462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1c4b8199-d3ba-4d92-8035-84f4ff55539e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147967 Apr 19 04:02:25.712078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 860/1671] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:25 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:26.730563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1eaab4fb-f089-4d88-bf1f-c201488a458a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:26.731259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1eaab4fb-f089-4d88-bf1f-c201488a458a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:26.739052 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1eaab4fb-f089-4d88-bf1f-c201488a458a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:26.739600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1eaab4fb-f089-4d88-bf1f-c201488a458a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:26.740423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1eaab4fb-f089-4d88-bf1f-c201488a458a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:26.740906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1eaab4fb-f089-4d88-bf1f-c201488a458a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:26.864625 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1eaab4fb-f089-4d88-bf1f-c201488a458a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:26.874638 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1eaab4fb-f089-4d88-bf1f-c201488a458a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148808 Apr 19 04:02:26.875272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 812/1672] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:26 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:27.893253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-592110b0-d7cf-41b4-9711-36f710041ce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:27.893864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-592110b0-d7cf-41b4-9711-36f710041ce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:27.903316 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-592110b0-d7cf-41b4-9711-36f710041ce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:27.903824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-592110b0-d7cf-41b4-9711-36f710041ce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:27.904647 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-592110b0-d7cf-41b4-9711-36f710041ce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:27.905133 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-592110b0-d7cf-41b4-9711-36f710041ce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:28.026910 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-592110b0-d7cf-41b4-9711-36f710041ce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:28.036778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-592110b0-d7cf-41b4-9711-36f710041ce8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147822 Apr 19 04:02:28.037390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 861/1673] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:27 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:29.054895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-0f84b479-41dc-444b-84a7-0cb8f102e297 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:29.055596 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-0f84b479-41dc-444b-84a7-0cb8f102e297 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:29.063421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f84b479-41dc-444b-84a7-0cb8f102e297 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:29.063928 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f84b479-41dc-444b-84a7-0cb8f102e297 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:29.064754 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f84b479-41dc-444b-84a7-0cb8f102e297 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:29.065242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-0f84b479-41dc-444b-84a7-0cb8f102e297 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:29.190370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-0f84b479-41dc-444b-84a7-0cb8f102e297 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:29.201037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-0f84b479-41dc-444b-84a7-0cb8f102e297 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150358 Apr 19 04:02:29.201654 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 813/1674] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:29 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:30.220013 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1048237d-b976-447e-9ab3-68b378425de9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:30.220692 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1048237d-b976-447e-9ab3-68b378425de9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:30.228565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1048237d-b976-447e-9ab3-68b378425de9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:30.229075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1048237d-b976-447e-9ab3-68b378425de9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:30.229912 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1048237d-b976-447e-9ab3-68b378425de9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:30.230397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1048237d-b976-447e-9ab3-68b378425de9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:30.360118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1048237d-b976-447e-9ab3-68b378425de9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:30.370024 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1048237d-b976-447e-9ab3-68b378425de9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.154141 Apr 19 04:02:30.371177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 862/1675] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:30 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:31.389054 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bd4f6b0c-6c38-44b7-bcaf-1d58fb6b1a48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:31.389720 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bd4f6b0c-6c38-44b7-bcaf-1d58fb6b1a48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:31.397565 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd4f6b0c-6c38-44b7-bcaf-1d58fb6b1a48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:31.398069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd4f6b0c-6c38-44b7-bcaf-1d58fb6b1a48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:31.398892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd4f6b0c-6c38-44b7-bcaf-1d58fb6b1a48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:31.399422 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bd4f6b0c-6c38-44b7-bcaf-1d58fb6b1a48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:31.522481 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bd4f6b0c-6c38-44b7-bcaf-1d58fb6b1a48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:31.533129 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bd4f6b0c-6c38-44b7-bcaf-1d58fb6b1a48 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148652 Apr 19 04:02:31.533899 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 814/1676] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:31 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:32.550080 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-49a02e7a-a023-4d71-89a1-7bb711e78bca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:32.550740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-49a02e7a-a023-4d71-89a1-7bb711e78bca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:32.558545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49a02e7a-a023-4d71-89a1-7bb711e78bca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:32.559050 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49a02e7a-a023-4d71-89a1-7bb711e78bca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:32.559934 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49a02e7a-a023-4d71-89a1-7bb711e78bca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:32.560429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-49a02e7a-a023-4d71-89a1-7bb711e78bca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:32.684043 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-49a02e7a-a023-4d71-89a1-7bb711e78bca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:32.693782 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-49a02e7a-a023-4d71-89a1-7bb711e78bca tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147779 Apr 19 04:02:32.694334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 863/1677] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:32 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:33.711544 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-863e2407-6828-43e0-a379-8ef09225cad2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:33.712162 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-863e2407-6828-43e0-a379-8ef09225cad2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:33.720000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-863e2407-6828-43e0-a379-8ef09225cad2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:33.720501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-863e2407-6828-43e0-a379-8ef09225cad2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:33.721321 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-863e2407-6828-43e0-a379-8ef09225cad2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:33.721814 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-863e2407-6828-43e0-a379-8ef09225cad2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:33.846147 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-863e2407-6828-43e0-a379-8ef09225cad2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:33.856545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-863e2407-6828-43e0-a379-8ef09225cad2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149153 Apr 19 04:02:33.857156 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 815/1678] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:33 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:34.874095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c542072c-4716-4055-8f87-0b021fe507e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:34.874709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c542072c-4716-4055-8f87-0b021fe507e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:34.882512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c542072c-4716-4055-8f87-0b021fe507e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:34.883019 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c542072c-4716-4055-8f87-0b021fe507e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:34.883906 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c542072c-4716-4055-8f87-0b021fe507e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:34.884401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c542072c-4716-4055-8f87-0b021fe507e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:35.006808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c542072c-4716-4055-8f87-0b021fe507e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:35.017037 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c542072c-4716-4055-8f87-0b021fe507e2 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147429 Apr 19 04:02:35.017656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 864/1679] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:34 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:36.035478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1cd6c649-1b10-464e-b12c-df10dcfa9edb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:36.036120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1cd6c649-1b10-464e-b12c-df10dcfa9edb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:36.044454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cd6c649-1b10-464e-b12c-df10dcfa9edb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:36.044950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cd6c649-1b10-464e-b12c-df10dcfa9edb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:36.045763 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cd6c649-1b10-464e-b12c-df10dcfa9edb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:36.046247 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1cd6c649-1b10-464e-b12c-df10dcfa9edb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:36.171995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1cd6c649-1b10-464e-b12c-df10dcfa9edb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:36.181712 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1cd6c649-1b10-464e-b12c-df10dcfa9edb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150396 Apr 19 04:02:36.182318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 816/1680] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:36 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:37.200636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5175801d-1369-4179-aeaa-9f9e61196a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:37.201305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5175801d-1369-4179-aeaa-9f9e61196a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:37.209185 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5175801d-1369-4179-aeaa-9f9e61196a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:37.209688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5175801d-1369-4179-aeaa-9f9e61196a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:37.210511 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5175801d-1369-4179-aeaa-9f9e61196a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:37.210998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5175801d-1369-4179-aeaa-9f9e61196a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:37.338573 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5175801d-1369-4179-aeaa-9f9e61196a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:37.348811 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5175801d-1369-4179-aeaa-9f9e61196a07 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152778 Apr 19 04:02:37.349429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 865/1681] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:37 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:38.367459 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1b5d1031-910a-48fd-b679-b04bcc9d0d74 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:38.368130 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1b5d1031-910a-48fd-b679-b04bcc9d0d74 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:38.376299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1b5d1031-910a-48fd-b679-b04bcc9d0d74 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:38.376801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1b5d1031-910a-48fd-b679-b04bcc9d0d74 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:38.377618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1b5d1031-910a-48fd-b679-b04bcc9d0d74 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:38.378103 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1b5d1031-910a-48fd-b679-b04bcc9d0d74 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:38.499601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1b5d1031-910a-48fd-b679-b04bcc9d0d74 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:38.509401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1b5d1031-910a-48fd-b679-b04bcc9d0d74 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146101 Apr 19 04:02:38.510010 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 817/1682] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:38 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:39.528008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6b3eb89f-325a-4b2a-946b-be703cdede37 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:39.528677 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6b3eb89f-325a-4b2a-946b-be703cdede37 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:39.536445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b3eb89f-325a-4b2a-946b-be703cdede37 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:39.536945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b3eb89f-325a-4b2a-946b-be703cdede37 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:39.537768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b3eb89f-325a-4b2a-946b-be703cdede37 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:39.538257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6b3eb89f-325a-4b2a-946b-be703cdede37 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:39.661006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6b3eb89f-325a-4b2a-946b-be703cdede37 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:39.671253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6b3eb89f-325a-4b2a-946b-be703cdede37 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147445 Apr 19 04:02:39.671869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 866/1683] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:39 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:40.688347 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1dc78fdc-df17-49be-963d-953a161abe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:40.689028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1dc78fdc-df17-49be-963d-953a161abe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:40.696901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1dc78fdc-df17-49be-963d-953a161abe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:40.697421 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1dc78fdc-df17-49be-963d-953a161abe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:40.698747 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1dc78fdc-df17-49be-963d-953a161abe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:40.699267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1dc78fdc-df17-49be-963d-953a161abe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:40.824230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1dc78fdc-df17-49be-963d-953a161abe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:40.834072 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1dc78fdc-df17-49be-963d-953a161abe89 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149825 Apr 19 04:02:40.834691 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 818/1684] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:40 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:41.852138 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fefe65bd-cb4f-45f1-b428-da2576af7614 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:41.852761 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fefe65bd-cb4f-45f1-b428-da2576af7614 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:41.861294 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fefe65bd-cb4f-45f1-b428-da2576af7614 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:41.861834 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fefe65bd-cb4f-45f1-b428-da2576af7614 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:41.862706 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fefe65bd-cb4f-45f1-b428-da2576af7614 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:41.863219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fefe65bd-cb4f-45f1-b428-da2576af7614 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:41.984929 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fefe65bd-cb4f-45f1-b428-da2576af7614 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:41.994714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fefe65bd-cb4f-45f1-b428-da2576af7614 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146731 Apr 19 04:02:41.995938 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 867/1685] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:41 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:43.013636 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-52f716ba-f170-4cde-9e89-00704b4f66c5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:43.014306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-52f716ba-f170-4cde-9e89-00704b4f66c5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:43.022202 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52f716ba-f170-4cde-9e89-00704b4f66c5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:43.022701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52f716ba-f170-4cde-9e89-00704b4f66c5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:43.023546 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52f716ba-f170-4cde-9e89-00704b4f66c5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:43.024030 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-52f716ba-f170-4cde-9e89-00704b4f66c5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:43.149722 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-52f716ba-f170-4cde-9e89-00704b4f66c5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:43.160266 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-52f716ba-f170-4cde-9e89-00704b4f66c5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150748 Apr 19 04:02:43.160876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 819/1686] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:43 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:44.179327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fb19f4fc-fdd6-4394-9b00-1bbef5f36f01 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:44.180000 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fb19f4fc-fdd6-4394-9b00-1bbef5f36f01 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:44.187920 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb19f4fc-fdd6-4394-9b00-1bbef5f36f01 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:44.188431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb19f4fc-fdd6-4394-9b00-1bbef5f36f01 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:44.189254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb19f4fc-fdd6-4394-9b00-1bbef5f36f01 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:44.189742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb19f4fc-fdd6-4394-9b00-1bbef5f36f01 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:44.318033 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fb19f4fc-fdd6-4394-9b00-1bbef5f36f01 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:44.327993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fb19f4fc-fdd6-4394-9b00-1bbef5f36f01 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152865 Apr 19 04:02:44.328618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 868/1687] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:44 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:45.345998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-22f41fd2-be66-4033-9ea2-e2a214b723e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:45.346591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-22f41fd2-be66-4033-9ea2-e2a214b723e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:45.355191 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22f41fd2-be66-4033-9ea2-e2a214b723e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:45.355713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22f41fd2-be66-4033-9ea2-e2a214b723e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:45.356543 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22f41fd2-be66-4033-9ea2-e2a214b723e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:45.357038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-22f41fd2-be66-4033-9ea2-e2a214b723e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:45.478609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-22f41fd2-be66-4033-9ea2-e2a214b723e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:45.489002 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-22f41fd2-be66-4033-9ea2-e2a214b723e0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147222 Apr 19 04:02:45.489614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 820/1688] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:45 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:46.507028 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-50bc0278-769b-4d4b-bed9-daf419060d57 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:46.507750 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-50bc0278-769b-4d4b-bed9-daf419060d57 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:46.515621 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50bc0278-769b-4d4b-bed9-daf419060d57 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:46.516123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50bc0278-769b-4d4b-bed9-daf419060d57 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:46.516941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50bc0278-769b-4d4b-bed9-daf419060d57 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:46.517427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-50bc0278-769b-4d4b-bed9-daf419060d57 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:46.641818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-50bc0278-769b-4d4b-bed9-daf419060d57 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:46.652217 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-50bc0278-769b-4d4b-bed9-daf419060d57 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149262 Apr 19 04:02:46.652813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 869/1689] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:46 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:47.670795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ce4d1255-3705-4335-8baf-cd96d7187802 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:47.671510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ce4d1255-3705-4335-8baf-cd96d7187802 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:47.679461 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce4d1255-3705-4335-8baf-cd96d7187802 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:47.679967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce4d1255-3705-4335-8baf-cd96d7187802 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:47.680795 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce4d1255-3705-4335-8baf-cd96d7187802 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:47.681292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ce4d1255-3705-4335-8baf-cd96d7187802 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:47.806637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ce4d1255-3705-4335-8baf-cd96d7187802 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:47.816651 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ce4d1255-3705-4335-8baf-cd96d7187802 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150586 Apr 19 04:02:47.817280 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 821/1690] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:47 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:48.835107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b1fa6a13-bef8-4c57-899f-90c487c95d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:48.835849 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b1fa6a13-bef8-4c57-899f-90c487c95d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:48.843710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b1fa6a13-bef8-4c57-899f-90c487c95d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:48.844157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b1fa6a13-bef8-4c57-899f-90c487c95d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:48.844978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b1fa6a13-bef8-4c57-899f-90c487c95d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:48.845462 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b1fa6a13-bef8-4c57-899f-90c487c95d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:48.973237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b1fa6a13-bef8-4c57-899f-90c487c95d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:48.984076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b1fa6a13-bef8-4c57-899f-90c487c95d1c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.153023 Apr 19 04:02:48.984710 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 870/1691] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:48 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:50.002106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d8736138-055c-416a-bb38-d359ec408ed1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:50.002775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d8736138-055c-416a-bb38-d359ec408ed1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:50.011179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8736138-055c-416a-bb38-d359ec408ed1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:50.011689 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8736138-055c-416a-bb38-d359ec408ed1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:50.012514 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8736138-055c-416a-bb38-d359ec408ed1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:50.012996 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d8736138-055c-416a-bb38-d359ec408ed1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:50.271075 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d8736138-055c-416a-bb38-d359ec408ed1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:50.280801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d8736138-055c-416a-bb38-d359ec408ed1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.283026 Apr 19 04:02:50.281399 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 822/1692] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:49 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:51.299091 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-755af9f6-d82b-449f-9cc4-90ea6aee5a05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:51.299841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-755af9f6-d82b-449f-9cc4-90ea6aee5a05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:51.307711 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-755af9f6-d82b-449f-9cc4-90ea6aee5a05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:51.308222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-755af9f6-d82b-449f-9cc4-90ea6aee5a05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:51.309059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-755af9f6-d82b-449f-9cc4-90ea6aee5a05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:51.309557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-755af9f6-d82b-449f-9cc4-90ea6aee5a05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:51.439883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-755af9f6-d82b-449f-9cc4-90ea6aee5a05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:51.449907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-755af9f6-d82b-449f-9cc4-90ea6aee5a05 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.155129 Apr 19 04:02:51.450532 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 871/1693] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:51 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:52.467820 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-35e95c6a-39e0-4165-95ad-ea8ce024c26a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:52.468485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-35e95c6a-39e0-4165-95ad-ea8ce024c26a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:52.476318 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35e95c6a-39e0-4165-95ad-ea8ce024c26a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:52.476767 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35e95c6a-39e0-4165-95ad-ea8ce024c26a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:52.477600 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35e95c6a-39e0-4165-95ad-ea8ce024c26a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:52.478092 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-35e95c6a-39e0-4165-95ad-ea8ce024c26a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:52.600644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-35e95c6a-39e0-4165-95ad-ea8ce024c26a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:52.611048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-35e95c6a-39e0-4165-95ad-ea8ce024c26a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147302 Apr 19 04:02:52.611690 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 823/1694] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:52 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:53.629872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-00919f2c-e252-4700-9147-1b4ffa8863f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:53.630686 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-00919f2c-e252-4700-9147-1b4ffa8863f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:53.638613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00919f2c-e252-4700-9147-1b4ffa8863f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:53.639119 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00919f2c-e252-4700-9147-1b4ffa8863f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:53.639993 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00919f2c-e252-4700-9147-1b4ffa8863f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:53.640484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-00919f2c-e252-4700-9147-1b4ffa8863f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:53.762941 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-00919f2c-e252-4700-9147-1b4ffa8863f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:53.773230 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-00919f2c-e252-4700-9147-1b4ffa8863f7 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146996 Apr 19 04:02:53.773883 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 872/1695] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:53 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:54.791733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-45a3e2f6-242d-4859-807c-fb10d7d3dbdf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:54.792406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-45a3e2f6-242d-4859-807c-fb10d7d3dbdf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:54.800155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45a3e2f6-242d-4859-807c-fb10d7d3dbdf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:54.800663 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45a3e2f6-242d-4859-807c-fb10d7d3dbdf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:54.801483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45a3e2f6-242d-4859-807c-fb10d7d3dbdf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:54.801969 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-45a3e2f6-242d-4859-807c-fb10d7d3dbdf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:54.927107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-45a3e2f6-242d-4859-807c-fb10d7d3dbdf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:54.936886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-45a3e2f6-242d-4859-807c-fb10d7d3dbdf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149216 Apr 19 04:02:54.937491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 824/1696] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:54 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:55.954876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-486ea843-926e-4679-b335-c94301b39148 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:55.955604 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-486ea843-926e-4679-b335-c94301b39148 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:55.964177 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-486ea843-926e-4679-b335-c94301b39148 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:55.964730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-486ea843-926e-4679-b335-c94301b39148 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:55.965558 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-486ea843-926e-4679-b335-c94301b39148 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:55.966047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-486ea843-926e-4679-b335-c94301b39148 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:56.087649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-486ea843-926e-4679-b335-c94301b39148 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:56.098020 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-486ea843-926e-4679-b335-c94301b39148 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147305 Apr 19 04:02:56.098638 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 873/1697] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:55 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:57.116041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-06d0fc7e-db4b-4d0b-87ab-c123919a52a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:57.116713 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-06d0fc7e-db4b-4d0b-87ab-c123919a52a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:57.125641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06d0fc7e-db4b-4d0b-87ab-c123919a52a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:57.126107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06d0fc7e-db4b-4d0b-87ab-c123919a52a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:57.126942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06d0fc7e-db4b-4d0b-87ab-c123919a52a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:57.127466 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06d0fc7e-db4b-4d0b-87ab-c123919a52a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:57.250369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-06d0fc7e-db4b-4d0b-87ab-c123919a52a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:57.260357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-06d0fc7e-db4b-4d0b-87ab-c123919a52a1 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148463 Apr 19 04:02:57.260968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 825/1698] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:57 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:58.278339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-8e2f5167-7766-47a0-b94a-6e69980531cb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:58.279012 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-8e2f5167-7766-47a0-b94a-6e69980531cb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:58.286803 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e2f5167-7766-47a0-b94a-6e69980531cb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:58.287369 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e2f5167-7766-47a0-b94a-6e69980531cb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:58.288174 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e2f5167-7766-47a0-b94a-6e69980531cb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:58.288665 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-8e2f5167-7766-47a0-b94a-6e69980531cb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:58.417061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-8e2f5167-7766-47a0-b94a-6e69980531cb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:58.426739 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-8e2f5167-7766-47a0-b94a-6e69980531cb tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152597 Apr 19 04:02:58.427386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 874/1699] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:58 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:02:59.445166 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-329f1ae6-b7c6-4f0c-aa98-7913005016da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:02:59.445863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-329f1ae6-b7c6-4f0c-aa98-7913005016da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:02:59.454233 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-329f1ae6-b7c6-4f0c-aa98-7913005016da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:59.454736 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-329f1ae6-b7c6-4f0c-aa98-7913005016da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:59.455583 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-329f1ae6-b7c6-4f0c-aa98-7913005016da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:02:59.456064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-329f1ae6-b7c6-4f0c-aa98-7913005016da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:02:59.578085 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-329f1ae6-b7c6-4f0c-aa98-7913005016da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:02:59.588104 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-329f1ae6-b7c6-4f0c-aa98-7913005016da tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146922 Apr 19 04:02:59.588714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 826/1700] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:02:59 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:00.605949 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6845474f-de4d-48b5-9d42-a98aa6e5915e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:00.606610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6845474f-de4d-48b5-9d42-a98aa6e5915e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:00.614390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6845474f-de4d-48b5-9d42-a98aa6e5915e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:00.614888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6845474f-de4d-48b5-9d42-a98aa6e5915e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:00.615727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6845474f-de4d-48b5-9d42-a98aa6e5915e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:00.616216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6845474f-de4d-48b5-9d42-a98aa6e5915e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:00.737897 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6845474f-de4d-48b5-9d42-a98aa6e5915e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:00.747592 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6845474f-de4d-48b5-9d42-a98aa6e5915e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.145683 Apr 19 04:03:00.748456 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 875/1701] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:00 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:01.766267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-d0d80bce-9f72-41b5-b9db-5a6c9134713b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:01.766937 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-d0d80bce-9f72-41b5-b9db-5a6c9134713b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:01.774812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0d80bce-9f72-41b5-b9db-5a6c9134713b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:01.775353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0d80bce-9f72-41b5-b9db-5a6c9134713b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:01.776173 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0d80bce-9f72-41b5-b9db-5a6c9134713b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:01.776659 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-d0d80bce-9f72-41b5-b9db-5a6c9134713b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:01.902968 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-d0d80bce-9f72-41b5-b9db-5a6c9134713b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:01.912742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-d0d80bce-9f72-41b5-b9db-5a6c9134713b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150572 Apr 19 04:03:01.913357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 827/1702] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:01 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:02.930847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4b9f220a-3b1b-4d71-83ae-681b0873da85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:02.931530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4b9f220a-3b1b-4d71-83ae-681b0873da85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:02.939608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b9f220a-3b1b-4d71-83ae-681b0873da85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:02.940115 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b9f220a-3b1b-4d71-83ae-681b0873da85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:02.940942 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b9f220a-3b1b-4d71-83ae-681b0873da85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:02.941430 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4b9f220a-3b1b-4d71-83ae-681b0873da85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:03.063523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4b9f220a-3b1b-4d71-83ae-681b0873da85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:03.073892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4b9f220a-3b1b-4d71-83ae-681b0873da85 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147362 Apr 19 04:03:03.074504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 876/1703] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:02 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:04.091742 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7d203c05-a0bd-4f35-a888-4c8576afd33e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:04.092403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7d203c05-a0bd-4f35-a888-4c8576afd33e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:04.100260 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7d203c05-a0bd-4f35-a888-4c8576afd33e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:04.100768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7d203c05-a0bd-4f35-a888-4c8576afd33e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:04.101588 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7d203c05-a0bd-4f35-a888-4c8576afd33e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:04.102069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7d203c05-a0bd-4f35-a888-4c8576afd33e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:04.222737 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7d203c05-a0bd-4f35-a888-4c8576afd33e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:04.233331 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7d203c05-a0bd-4f35-a888-4c8576afd33e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146283 Apr 19 04:03:04.233943 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 828/1704] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:04 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:05.252236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9ceaedc0-c92a-46f8-bc24-4842c86bb4ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:05.252905 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9ceaedc0-c92a-46f8-bc24-4842c86bb4ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:05.260695 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ceaedc0-c92a-46f8-bc24-4842c86bb4ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:05.261192 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ceaedc0-c92a-46f8-bc24-4842c86bb4ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:05.262008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ceaedc0-c92a-46f8-bc24-4842c86bb4ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:05.262492 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9ceaedc0-c92a-46f8-bc24-4842c86bb4ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:05.626614 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9ceaedc0-c92a-46f8-bc24-4842c86bb4ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:05.636624 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9ceaedc0-c92a-46f8-bc24-4842c86bb4ba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.388759 Apr 19 04:03:05.637232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 877/1705] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:05 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:06.654305 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b3cc2194-3b61-4d56-a8c8-a784ca7d5dec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:06.654967 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b3cc2194-3b61-4d56-a8c8-a784ca7d5dec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:06.662693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3cc2194-3b61-4d56-a8c8-a784ca7d5dec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:06.663214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3cc2194-3b61-4d56-a8c8-a784ca7d5dec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:06.664042 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3cc2194-3b61-4d56-a8c8-a784ca7d5dec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:06.664536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b3cc2194-3b61-4d56-a8c8-a784ca7d5dec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:06.786188 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b3cc2194-3b61-4d56-a8c8-a784ca7d5dec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:06.796623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b3cc2194-3b61-4d56-a8c8-a784ca7d5dec tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146379 Apr 19 04:03:06.797237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 829/1706] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:06 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:06.839222 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:03:06.839386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:03:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:03:07.814438 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-94bc7679-82b6-4adf-a6f8-94f7c1244f10 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:07.815194 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-94bc7679-82b6-4adf-a6f8-94f7c1244f10 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:07.823617 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94bc7679-82b6-4adf-a6f8-94f7c1244f10 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:07.824125 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94bc7679-82b6-4adf-a6f8-94f7c1244f10 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:07.824954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94bc7679-82b6-4adf-a6f8-94f7c1244f10 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:07.825442 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-94bc7679-82b6-4adf-a6f8-94f7c1244f10 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:08.035999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-94bc7679-82b6-4adf-a6f8-94f7c1244f10 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:08.045856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-94bc7679-82b6-4adf-a6f8-94f7c1244f10 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.235621 Apr 19 04:03:08.046472 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 878/1707] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:07 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:08.106392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:03:08.106577 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:03:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:03:09.063724 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7e54095e-fb81-478b-bc2f-ccbaec6b9189 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:09.064390 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7e54095e-fb81-478b-bc2f-ccbaec6b9189 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:09.072239 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e54095e-fb81-478b-bc2f-ccbaec6b9189 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:09.073254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e54095e-fb81-478b-bc2f-ccbaec6b9189 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:09.074049 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e54095e-fb81-478b-bc2f-ccbaec6b9189 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:09.074533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7e54095e-fb81-478b-bc2f-ccbaec6b9189 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:09.248991 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7e54095e-fb81-478b-bc2f-ccbaec6b9189 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:09.258777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7e54095e-fb81-478b-bc2f-ccbaec6b9189 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.199280 Apr 19 04:03:09.259409 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 830/1708] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:09 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:10.277923 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ff091ab9-fe76-4046-9b11-c34a728f9735 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:10.278598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ff091ab9-fe76-4046-9b11-c34a728f9735 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:10.286504 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff091ab9-fe76-4046-9b11-c34a728f9735 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:10.287006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff091ab9-fe76-4046-9b11-c34a728f9735 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:10.287866 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff091ab9-fe76-4046-9b11-c34a728f9735 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:10.288368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ff091ab9-fe76-4046-9b11-c34a728f9735 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:10.410236 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ff091ab9-fe76-4046-9b11-c34a728f9735 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:10.420058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ff091ab9-fe76-4046-9b11-c34a728f9735 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146746 Apr 19 04:03:10.420675 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 879/1709] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:10 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:11.438548 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6f82cced-e2f9-49ac-8958-3e879b8b273a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:11.439228 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6f82cced-e2f9-49ac-8958-3e879b8b273a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:11.447098 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f82cced-e2f9-49ac-8958-3e879b8b273a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:11.447664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f82cced-e2f9-49ac-8958-3e879b8b273a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:11.448493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f82cced-e2f9-49ac-8958-3e879b8b273a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:11.448978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6f82cced-e2f9-49ac-8958-3e879b8b273a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:11.570392 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6f82cced-e2f9-49ac-8958-3e879b8b273a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:11.580277 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6f82cced-e2f9-49ac-8958-3e879b8b273a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.145775 Apr 19 04:03:11.580865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 831/1710] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:11 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:12.599007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e7b9cafb-c051-41ac-b353-0add6cf7b242 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:12.599707 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e7b9cafb-c051-41ac-b353-0add6cf7b242 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:12.607559 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7b9cafb-c051-41ac-b353-0add6cf7b242 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:12.608068 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7b9cafb-c051-41ac-b353-0add6cf7b242 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:12.608887 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7b9cafb-c051-41ac-b353-0add6cf7b242 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:12.609374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e7b9cafb-c051-41ac-b353-0add6cf7b242 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:12.736061 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e7b9cafb-c051-41ac-b353-0add6cf7b242 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:12.745800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e7b9cafb-c051-41ac-b353-0add6cf7b242 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.150877 Apr 19 04:03:12.746411 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 880/1711] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:12 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:13.764087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fb7653a1-fdc2-4701-a717-9ed82abb3de8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:13.764701 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fb7653a1-fdc2-4701-a717-9ed82abb3de8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:13.772970 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb7653a1-fdc2-4701-a717-9ed82abb3de8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:13.773479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb7653a1-fdc2-4701-a717-9ed82abb3de8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:13.774309 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb7653a1-fdc2-4701-a717-9ed82abb3de8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:13.774802 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fb7653a1-fdc2-4701-a717-9ed82abb3de8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:13.896477 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fb7653a1-fdc2-4701-a717-9ed82abb3de8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:13.906719 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fb7653a1-fdc2-4701-a717-9ed82abb3de8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146770 Apr 19 04:03:13.907357 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 832/1712] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:13 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:14.925478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3c5f8699-7990-41c9-b7d0-e0f88ca9c70b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:14.926087 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3c5f8699-7990-41c9-b7d0-e0f88ca9c70b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:14.933901 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c5f8699-7990-41c9-b7d0-e0f88ca9c70b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:14.934400 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c5f8699-7990-41c9-b7d0-e0f88ca9c70b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:14.935245 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c5f8699-7990-41c9-b7d0-e0f88ca9c70b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:14.935733 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3c5f8699-7990-41c9-b7d0-e0f88ca9c70b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:15.056650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3c5f8699-7990-41c9-b7d0-e0f88ca9c70b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:15.066574 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3c5f8699-7990-41c9-b7d0-e0f88ca9c70b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.145307 Apr 19 04:03:15.067207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 881/1713] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:14 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:16.085189 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b792b63c-6363-45a4-8ebe-0b3f11c59b43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:16.085864 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b792b63c-6363-45a4-8ebe-0b3f11c59b43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:16.094157 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b792b63c-6363-45a4-8ebe-0b3f11c59b43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:16.094671 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b792b63c-6363-45a4-8ebe-0b3f11c59b43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:16.095540 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b792b63c-6363-45a4-8ebe-0b3f11c59b43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:16.096029 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b792b63c-6363-45a4-8ebe-0b3f11c59b43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:16.222858 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b792b63c-6363-45a4-8ebe-0b3f11c59b43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:16.233353 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b792b63c-6363-45a4-8ebe-0b3f11c59b43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152312 Apr 19 04:03:16.233959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 833/1714] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:16 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:17.251237 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-353e5d2d-3a73-4249-ae41-591a6f5c4f51 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:17.251904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-353e5d2d-3a73-4249-ae41-591a6f5c4f51 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:17.259794 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-353e5d2d-3a73-4249-ae41-591a6f5c4f51 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:17.260284 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-353e5d2d-3a73-4249-ae41-591a6f5c4f51 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:17.261102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-353e5d2d-3a73-4249-ae41-591a6f5c4f51 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:17.261597 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-353e5d2d-3a73-4249-ae41-591a6f5c4f51 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:17.385406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-353e5d2d-3a73-4249-ae41-591a6f5c4f51 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:17.395304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-353e5d2d-3a73-4249-ae41-591a6f5c4f51 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148379 Apr 19 04:03:17.395921 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 882/1715] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:17 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:18.413195 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2376843b-7932-4897-832e-0a9e551ecaed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:18.413862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2376843b-7932-4897-832e-0a9e551ecaed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:18.421632 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2376843b-7932-4897-832e-0a9e551ecaed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:18.422135 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2376843b-7932-4897-832e-0a9e551ecaed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:18.422954 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2376843b-7932-4897-832e-0a9e551ecaed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:18.423469 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2376843b-7932-4897-832e-0a9e551ecaed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:18.548118 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2376843b-7932-4897-832e-0a9e551ecaed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:18.559793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2376843b-7932-4897-832e-0a9e551ecaed tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149629 Apr 19 04:03:18.559793 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 834/1716] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:18 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:18.574670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5f4856f4-c48c-4c93-acb7-fe3b251b9c36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:18.575268 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5f4856f4-c48c-4c93-acb7-fe3b251b9c36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:18.583111 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f4856f4-c48c-4c93-acb7-fe3b251b9c36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:18.583641 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f4856f4-c48c-4c93-acb7-fe3b251b9c36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:18.584480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f4856f4-c48c-4c93-acb7-fe3b251b9c36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:18.584984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5f4856f4-c48c-4c93-acb7-fe3b251b9c36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:18.638432 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-5f4856f4-c48c-4c93-acb7-fe3b251b9c36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] HTTP exception thrown: Instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 could not be found. Apr 19 04:03:18.639229 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5f4856f4-c48c-4c93-acb7-fe3b251b9c36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Returning 404 to user: Instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 04:03:18.640216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5f4856f4-c48c-4c93-acb7-fe3b251b9c36 tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 404 len: 111 microversion: 2.1 time: 0.070336 Apr 19 04:03:18.640975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 883/1717] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 04:03:18 2021] DELETE /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 04:03:18.650756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5ecd3d1b-8826-4f2c-9c41-745c6f29cf0e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:18.655444 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5ecd3d1b-8826-4f2c-9c41-745c6f29cf0e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] [instance: e29b14f0-f43c-434b-b583-cdf6b0e4b784] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:18.659378 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ecd3d1b-8826-4f2c-9c41-745c6f29cf0e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:18.659886 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ecd3d1b-8826-4f2c-9c41-745c6f29cf0e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:18.660717 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ecd3d1b-8826-4f2c-9c41-745c6f29cf0e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:18.661209 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ecd3d1b-8826-4f2c-9c41-745c6f29cf0e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:18.714394 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-5ecd3d1b-8826-4f2c-9c41-745c6f29cf0e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] HTTP exception thrown: Instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 could not be found. Apr 19 04:03:18.715057 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5ecd3d1b-8826-4f2c-9c41-745c6f29cf0e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] Returning 404 to user: Instance e29b14f0-f43c-434b-b583-cdf6b0e4b784 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 04:03:18.715984 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5ecd3d1b-8826-4f2c-9c41-745c6f29cf0e tempest-AttachVolumeShelveTestJSON-256277953 tempest-AttachVolumeShelveTestJSON-256277953-project] 10.222.0.25 "GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784" status: 404 len: 111 microversion: 2.1 time: 0.070050 Apr 19 04:03:18.716580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 835/1718] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:18 2021] GET /compute/v2.1/servers/e29b14f0-f43c-434b-b583-cdf6b0e4b784 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 04:03:19.576853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5c369cfc-7a5b-40cd-96a4-b9ae1b750002 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:19.577587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5c369cfc-7a5b-40cd-96a4-b9ae1b750002 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:19.585315 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c369cfc-7a5b-40cd-96a4-b9ae1b750002 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:19.585823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c369cfc-7a5b-40cd-96a4-b9ae1b750002 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:19.586649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c369cfc-7a5b-40cd-96a4-b9ae1b750002 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:19.587165 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5c369cfc-7a5b-40cd-96a4-b9ae1b750002 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:19.717873 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5c369cfc-7a5b-40cd-96a4-b9ae1b750002 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:19.727734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5c369cfc-7a5b-40cd-96a4-b9ae1b750002 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.154970 Apr 19 04:03:19.729235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 884/1719] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:19 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:20.747081 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-959c8d64-b571-4ebd-a13f-5d7927bd7e6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:20.747702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-959c8d64-b571-4ebd-a13f-5d7927bd7e6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:20.756168 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-959c8d64-b571-4ebd-a13f-5d7927bd7e6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:20.756670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-959c8d64-b571-4ebd-a13f-5d7927bd7e6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:20.757519 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-959c8d64-b571-4ebd-a13f-5d7927bd7e6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:20.758026 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-959c8d64-b571-4ebd-a13f-5d7927bd7e6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:20.998696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-959c8d64-b571-4ebd-a13f-5d7927bd7e6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:21.008534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-959c8d64-b571-4ebd-a13f-5d7927bd7e6b tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.266251 Apr 19 04:03:21.009143 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 836/1720] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:20 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:22.026809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6a22cf9a-701c-43de-b3c4-11b2f6fe2c58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:22.027508 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6a22cf9a-701c-43de-b3c4-11b2f6fe2c58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:22.035425 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a22cf9a-701c-43de-b3c4-11b2f6fe2c58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:22.036139 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a22cf9a-701c-43de-b3c4-11b2f6fe2c58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:22.036997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a22cf9a-701c-43de-b3c4-11b2f6fe2c58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:22.037702 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-6a22cf9a-701c-43de-b3c4-11b2f6fe2c58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:22.165083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6a22cf9a-701c-43de-b3c4-11b2f6fe2c58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:22.176389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6a22cf9a-701c-43de-b3c4-11b2f6fe2c58 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.154039 Apr 19 04:03:22.177338 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 885/1721] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:22 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:23.247926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7089b383-b5c5-48a0-bab3-7ed2ee557ef8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:23.248863 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7089b383-b5c5-48a0-bab3-7ed2ee557ef8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:23.258100 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7089b383-b5c5-48a0-bab3-7ed2ee557ef8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:23.258618 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7089b383-b5c5-48a0-bab3-7ed2ee557ef8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:23.260079 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7089b383-b5c5-48a0-bab3-7ed2ee557ef8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:23.260579 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7089b383-b5c5-48a0-bab3-7ed2ee557ef8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:23.390709 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7089b383-b5c5-48a0-bab3-7ed2ee557ef8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:23.401123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7089b383-b5c5-48a0-bab3-7ed2ee557ef8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.209837 Apr 19 04:03:23.401734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 837/1722] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:23 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:24.419646 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1d7cbcaf-3700-42db-b2cd-73aaeb93447f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:24.420220 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1d7cbcaf-3700-42db-b2cd-73aaeb93447f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:24.428856 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d7cbcaf-3700-42db-b2cd-73aaeb93447f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:24.429360 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d7cbcaf-3700-42db-b2cd-73aaeb93447f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:24.434036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d7cbcaf-3700-42db-b2cd-73aaeb93447f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:24.434036 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1d7cbcaf-3700-42db-b2cd-73aaeb93447f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:24.641794 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1d7cbcaf-3700-42db-b2cd-73aaeb93447f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:24.654627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1d7cbcaf-3700-42db-b2cd-73aaeb93447f tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.239603 Apr 19 04:03:24.655283 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 886/1723] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:24 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:25.673640 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e497c48a-fd62-4a03-8e44-63185e958979 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:25.674401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e497c48a-fd62-4a03-8e44-63185e958979 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:25.682933 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e497c48a-fd62-4a03-8e44-63185e958979 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:25.683491 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e497c48a-fd62-4a03-8e44-63185e958979 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:25.688947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e497c48a-fd62-4a03-8e44-63185e958979 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:25.688947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e497c48a-fd62-4a03-8e44-63185e958979 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:25.808947 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e497c48a-fd62-4a03-8e44-63185e958979 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:25.818789 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e497c48a-fd62-4a03-8e44-63185e958979 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149791 Apr 19 04:03:25.819427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 838/1724] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:25 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:26.455427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:03:26.455587 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:03:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:03:26.836780 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e8297004-8438-476a-b6fd-14441f072c43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:26.837613 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e8297004-8438-476a-b6fd-14441f072c43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:26.845473 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8297004-8438-476a-b6fd-14441f072c43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:26.845981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8297004-8438-476a-b6fd-14441f072c43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:26.846798 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8297004-8438-476a-b6fd-14441f072c43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:26.847339 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e8297004-8438-476a-b6fd-14441f072c43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:26.976729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e8297004-8438-476a-b6fd-14441f072c43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:26.987484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e8297004-8438-476a-b6fd-14441f072c43 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.154767 Apr 19 04:03:26.988110 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 887/1725] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:26 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:28.006015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b9fb51b9-bda0-4755-b454-187ca127109d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:28.006627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b9fb51b9-bda0-4755-b454-187ca127109d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:28.015064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9fb51b9-bda0-4755-b454-187ca127109d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:28.015599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9fb51b9-bda0-4755-b454-187ca127109d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:28.016427 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9fb51b9-bda0-4755-b454-187ca127109d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:28.016908 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b9fb51b9-bda0-4755-b454-187ca127109d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:28.146827 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b9fb51b9-bda0-4755-b454-187ca127109d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:28.157248 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b9fb51b9-bda0-4755-b454-187ca127109d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.155411 Apr 19 04:03:28.157955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 839/1726] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:28 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:29.175580 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-25574e6f-3587-409b-9aab-8a5cfebdae2e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:29.176258 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-25574e6f-3587-409b-9aab-8a5cfebdae2e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:29.184978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25574e6f-3587-409b-9aab-8a5cfebdae2e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:29.185493 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25574e6f-3587-409b-9aab-8a5cfebdae2e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:29.186332 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25574e6f-3587-409b-9aab-8a5cfebdae2e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:29.186832 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-25574e6f-3587-409b-9aab-8a5cfebdae2e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:29.308874 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-25574e6f-3587-409b-9aab-8a5cfebdae2e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:29.318668 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-25574e6f-3587-409b-9aab-8a5cfebdae2e tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147387 Apr 19 04:03:29.319304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 888/1727] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:29 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:30.337040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-163a8ad5-d9c4-45b5-9be7-bbc050a2ba98 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:30.337743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-163a8ad5-d9c4-45b5-9be7-bbc050a2ba98 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:30.345822 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-163a8ad5-d9c4-45b5-9be7-bbc050a2ba98 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:30.346330 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-163a8ad5-d9c4-45b5-9be7-bbc050a2ba98 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:30.347170 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-163a8ad5-d9c4-45b5-9be7-bbc050a2ba98 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:30.347696 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-163a8ad5-d9c4-45b5-9be7-bbc050a2ba98 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:30.471542 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-163a8ad5-d9c4-45b5-9be7-bbc050a2ba98 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:30.481387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-163a8ad5-d9c4-45b5-9be7-bbc050a2ba98 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148480 Apr 19 04:03:30.481998 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 840/1728] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:30 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:31.500347 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c3eec112-4b82-4e9b-8386-7140844f0984 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:31.501021 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-c3eec112-4b82-4e9b-8386-7140844f0984 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:31.508907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3eec112-4b82-4e9b-8386-7140844f0984 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:31.509902 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3eec112-4b82-4e9b-8386-7140844f0984 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:31.510730 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3eec112-4b82-4e9b-8386-7140844f0984 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:31.511242 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-c3eec112-4b82-4e9b-8386-7140844f0984 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:31.632986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-c3eec112-4b82-4e9b-8386-7140844f0984 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:31.643455 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c3eec112-4b82-4e9b-8386-7140844f0984 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.147429 Apr 19 04:03:31.644076 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 889/1729] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:31 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:32.662123 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9fae8ca9-c340-45f5-9a59-9114ef466b22 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:32.662801 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9fae8ca9-c340-45f5-9a59-9114ef466b22 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:32.671405 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fae8ca9-c340-45f5-9a59-9114ef466b22 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:32.671918 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fae8ca9-c340-45f5-9a59-9114ef466b22 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:32.672755 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fae8ca9-c340-45f5-9a59-9114ef466b22 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:32.673254 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9fae8ca9-c340-45f5-9a59-9114ef466b22 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:32.794807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-9fae8ca9-c340-45f5-9a59-9114ef466b22 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:32.804726 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9fae8ca9-c340-45f5-9a59-9114ef466b22 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146755 Apr 19 04:03:32.805349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 841/1730] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:32 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:33.822616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-92299a1b-7aec-4a0b-aa96-bec26d78625a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:33.823322 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-92299a1b-7aec-4a0b-aa96-bec26d78625a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:33.831183 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92299a1b-7aec-4a0b-aa96-bec26d78625a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:33.831697 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92299a1b-7aec-4a0b-aa96-bec26d78625a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:33.832525 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92299a1b-7aec-4a0b-aa96-bec26d78625a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:33.833016 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-92299a1b-7aec-4a0b-aa96-bec26d78625a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:33.960459 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-92299a1b-7aec-4a0b-aa96-bec26d78625a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:33.972445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-92299a1b-7aec-4a0b-aa96-bec26d78625a tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.153877 Apr 19 04:03:33.973064 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 890/1731] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:33 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:34.990945 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3caac6bb-a6d7-430b-b798-95e556ce501c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:34.991645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3caac6bb-a6d7-430b-b798-95e556ce501c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:35.000184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3caac6bb-a6d7-430b-b798-95e556ce501c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:35.000688 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3caac6bb-a6d7-430b-b798-95e556ce501c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:35.001512 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3caac6bb-a6d7-430b-b798-95e556ce501c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:35.001994 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3caac6bb-a6d7-430b-b798-95e556ce501c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:35.128069 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3caac6bb-a6d7-430b-b798-95e556ce501c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:35.143403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3caac6bb-a6d7-430b-b798-95e556ce501c tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.151317 Apr 19 04:03:35.143403 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 842/1732] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:34 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:36.156479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-4458e78c-a2cf-4bd4-b228-6a096e5573f5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:36.157179 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-4458e78c-a2cf-4bd4-b228-6a096e5573f5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:36.165047 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4458e78c-a2cf-4bd4-b228-6a096e5573f5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:36.165571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4458e78c-a2cf-4bd4-b228-6a096e5573f5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:36.166387 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4458e78c-a2cf-4bd4-b228-6a096e5573f5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:36.166878 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-4458e78c-a2cf-4bd4-b228-6a096e5573f5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:36.292510 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-4458e78c-a2cf-4bd4-b228-6a096e5573f5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:36.302269 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-4458e78c-a2cf-4bd4-b228-6a096e5573f5 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149897 Apr 19 04:03:36.302881 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 891/1733] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:36 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 04:03:37.320817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ae8ca988-0bac-44ab-818d-5e98b68491a9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:37.322015 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ae8ca988-0bac-44ab-818d-5e98b68491a9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:37.329948 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae8ca988-0bac-44ab-818d-5e98b68491a9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:37.330370 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae8ca988-0bac-44ab-818d-5e98b68491a9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:37.331238 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae8ca988-0bac-44ab-818d-5e98b68491a9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:37.331729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ae8ca988-0bac-44ab-818d-5e98b68491a9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:37.458401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ae8ca988-0bac-44ab-818d-5e98b68491a9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:37.468911 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ae8ca988-0bac-44ab-818d-5e98b68491a9 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152223 Apr 19 04:03:37.469586 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 843/1734] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:37 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:38.486218 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fea567a8-ad5d-484f-bfa2-17b41bc5308d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:38.486971 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fea567a8-ad5d-484f-bfa2-17b41bc5308d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:38.494895 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fea567a8-ad5d-484f-bfa2-17b41bc5308d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:38.495496 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fea567a8-ad5d-484f-bfa2-17b41bc5308d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:38.496334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fea567a8-ad5d-484f-bfa2-17b41bc5308d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:38.496826 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fea567a8-ad5d-484f-bfa2-17b41bc5308d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:38.642423 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-fea567a8-ad5d-484f-bfa2-17b41bc5308d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:38.652714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fea567a8-ad5d-484f-bfa2-17b41bc5308d tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.170650 Apr 19 04:03:38.653327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 892/1735] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:38 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:39.670590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-3662adcd-3592-4836-bdbe-8723662c1653 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:39.671289 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-3662adcd-3592-4836-bdbe-8723662c1653 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:39.679006 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3662adcd-3592-4836-bdbe-8723662c1653 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:39.679541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3662adcd-3592-4836-bdbe-8723662c1653 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:39.680361 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3662adcd-3592-4836-bdbe-8723662c1653 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:39.680847 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-3662adcd-3592-4836-bdbe-8723662c1653 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:39.801859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-3662adcd-3592-4836-bdbe-8723662c1653 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:39.811644 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-3662adcd-3592-4836-bdbe-8723662c1653 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.145113 Apr 19 04:03:39.812253 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 844/1736] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:39 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:40.829836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bb8bb539-364f-4b31-9431-ad04cd143ecf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:40.830460 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bb8bb539-364f-4b31-9431-ad04cd143ecf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:40.838323 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb8bb539-364f-4b31-9431-ad04cd143ecf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:40.838837 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb8bb539-364f-4b31-9431-ad04cd143ecf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:40.839700 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb8bb539-364f-4b31-9431-ad04cd143ecf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:40.840198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bb8bb539-364f-4b31-9431-ad04cd143ecf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:40.967925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bb8bb539-364f-4b31-9431-ad04cd143ecf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:40.977884 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bb8bb539-364f-4b31-9431-ad04cd143ecf tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.152216 Apr 19 04:03:40.978501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 893/1737] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:40 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:41.994892 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-56f49d98-725f-41f3-b134-26136ba207ff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:41.995598 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-56f49d98-725f-41f3-b134-26136ba207ff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:42.003703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56f49d98-725f-41f3-b134-26136ba207ff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:42.004207 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56f49d98-725f-41f3-b134-26136ba207ff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:42.005034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56f49d98-725f-41f3-b134-26136ba207ff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:42.005526 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-56f49d98-725f-41f3-b134-26136ba207ff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:42.129408 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-56f49d98-725f-41f3-b134-26136ba207ff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:42.139760 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-56f49d98-725f-41f3-b134-26136ba207ff tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.148989 Apr 19 04:03:42.140384 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 845/1738] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:41 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:43.157365 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-1ae43534-9816-4469-be46-b94ba06d4dba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:43.157987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-1ae43534-9816-4469-be46-b94ba06d4dba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:43.166404 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ae43534-9816-4469-be46-b94ba06d4dba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:43.166903 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ae43534-9816-4469-be46-b94ba06d4dba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:43.167777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ae43534-9816-4469-be46-b94ba06d4dba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:43.168265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-1ae43534-9816-4469-be46-b94ba06d4dba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:43.289643 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-1ae43534-9816-4469-be46-b94ba06d4dba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:43.299980 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-1ae43534-9816-4469-be46-b94ba06d4dba tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.146778 Apr 19 04:03:43.300599 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 894/1739] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:43 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:44.317812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-957745d7-fedd-41ba-a67e-f197a6adc7f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:44.318484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-957745d7-fedd-41ba-a67e-f197a6adc7f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:44.326335 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-957745d7-fedd-41ba-a67e-f197a6adc7f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:44.326840 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-957745d7-fedd-41ba-a67e-f197a6adc7f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:44.327703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-957745d7-fedd-41ba-a67e-f197a6adc7f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:44.328200 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-957745d7-fedd-41ba-a67e-f197a6adc7f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:44.453106 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-957745d7-fedd-41ba-a67e-f197a6adc7f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe48ae85de1643bc82155a724a28eb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b10cb882499b9bb1d15de040c189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:03:44.463320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-957745d7-fedd-41ba-a67e-f197a6adc7f0 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 200 len: 1416 microversion: 2.1 time: 0.149598 Apr 19 04:03:44.463936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 846/1740] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:44 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 1416 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:03:45.481401 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-06e653cf-8f95-4cb7-a251-1676f04c3463 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:45.482078 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-06e653cf-8f95-4cb7-a251-1676f04c3463 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:03:45.490044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06e653cf-8f95-4cb7-a251-1676f04c3463 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:45.490778 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06e653cf-8f95-4cb7-a251-1676f04c3463 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:45.491841 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06e653cf-8f95-4cb7-a251-1676f04c3463 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:03:45.492334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-06e653cf-8f95-4cb7-a251-1676f04c3463 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:03:45.566987 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-06e653cf-8f95-4cb7-a251-1676f04c3463 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] HTTP exception thrown: Instance 0656c7c5-439a-47a8-ab73-8a5e4e007bbd could not be found. Apr 19 04:03:45.567693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-06e653cf-8f95-4cb7-a251-1676f04c3463 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Returning 404 to user: Instance 0656c7c5-439a-47a8-ab73-8a5e4e007bbd could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 04:03:45.568608 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-06e653cf-8f95-4cb7-a251-1676f04c3463 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 404 len: 111 microversion: 2.1 time: 0.091436 Apr 19 04:03:45.569206 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 895/1741] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:03:45 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 04:03:45.579479 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-c10d2b4c-019d-4c4a-b991-ed4e473d40be tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '.version_select at 0x7f9dac4761e0>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:03:45.626107 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-c10d2b4c-019d-4c4a-b991-ed4e473d40be tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1710261813" status: 202 len: 0 microversion: 2.1 time: 0.051291 Apr 19 04:03:45.626749 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 847/1742] 10.222.0.25 () {58 vars in 1211 bytes} [Mon Apr 19 04:03:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1710261813 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 04:05:03.261962 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:05:03.262536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:05:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:05:10.296557 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:05:10.297114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:05:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:06:26.856790 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:06:26.857308 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:06:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:06:27.173346 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:06:27.173714 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:06:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:06:28.122914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:06:28.123410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:06:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:06:46.472386 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:06:46.472944 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:06:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:08:23.279329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:08:23.279787 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:08:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:08:30.314134 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:08:30.314605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:08:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:09:46.873261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:09:46.873764 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:09:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:09:47.190439 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:09:47.190622 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:09:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:09:48.139740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:09:48.140213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:09:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:10:06.488999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:10:06.489500 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:10:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:11:43.296541 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:11:43.297034 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:11:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:11:50.332234 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:11:50.332807 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:11:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:13:06.890429 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:13:06.890955 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:13:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:13:07.207823 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:13:07.207988 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:13:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:13:08.157181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:13:08.157679 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:13:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:13:26.506397 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:13:26.506885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:13:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:15:03.313757 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:15:03.314326 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:15:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:15:10.348964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:15:10.349478 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:15:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:15:47.238985 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fe00dfad-d120-4983-9e4d-20f8775003f8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:15:47.239605 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-fe00dfad-d120-4983-9e4d-20f8775003f8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:15:47.246997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 19 04:15:47.252356 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe00dfad-d120-4983-9e4d-20f8775003f8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:15:47.252861 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe00dfad-d120-4983-9e4d-20f8775003f8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:15:47.253734 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe00dfad-d120-4983-9e4d-20f8775003f8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:15:47.254219 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-fe00dfad-d120-4983-9e4d-20f8775003f8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:15:47.307216 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-fe00dfad-d120-4983-9e4d-20f8775003f8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] HTTP exception thrown: Instance 0656c7c5-439a-47a8-ab73-8a5e4e007bbd could not be found. Apr 19 04:15:47.307893 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-fe00dfad-d120-4983-9e4d-20f8775003f8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Returning 404 to user: Instance 0656c7c5-439a-47a8-ab73-8a5e4e007bbd could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 04:15:47.308784 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-fe00dfad-d120-4983-9e4d-20f8775003f8 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 404 len: 111 microversion: 2.1 time: 0.074646 Apr 19 04:15:47.309389 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 896/1743] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 04:15:47 2021] DELETE /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 04:15:47.315272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 19 04:15:47.318990 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-01205089-1230-4a77-9b8c-5645a3ffb067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:15:47.320235 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-01205089-1230-4a77-9b8c-5645a3ffb067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 0656c7c5-439a-47a8-ab73-8a5e4e007bbd] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:15:47.328027 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01205089-1230-4a77-9b8c-5645a3ffb067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:15:47.328538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01205089-1230-4a77-9b8c-5645a3ffb067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:15:47.329380 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01205089-1230-4a77-9b8c-5645a3ffb067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:15:47.329869 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-01205089-1230-4a77-9b8c-5645a3ffb067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:15:47.383299 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-01205089-1230-4a77-9b8c-5645a3ffb067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] HTTP exception thrown: Instance 0656c7c5-439a-47a8-ab73-8a5e4e007bbd could not be found. Apr 19 04:15:47.383989 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-01205089-1230-4a77-9b8c-5645a3ffb067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Returning 404 to user: Instance 0656c7c5-439a-47a8-ab73-8a5e4e007bbd could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 04:15:47.384888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-01205089-1230-4a77-9b8c-5645a3ffb067 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd" status: 404 len: 111 microversion: 2.1 time: 0.071148 Apr 19 04:15:47.385672 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 848/1744] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:15:47 2021] GET /compute/v2.1/servers/0656c7c5-439a-47a8-ab73-8a5e4e007bbd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 04:15:48.692865 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-794d7f01-3d2b-4fe3-bec0-52876bbffe71 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:15:48.693414 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-794d7f01-3d2b-4fe3-bec0-52876bbffe71 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:15:48.713077 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-794d7f01-3d2b-4fe3-bec0-52876bbffe71 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:15:48.713639 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-794d7f01-3d2b-4fe3-bec0-52876bbffe71 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:15:48.714480 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-794d7f01-3d2b-4fe3-bec0-52876bbffe71 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:15:48.714964 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-794d7f01-3d2b-4fe3-bec0-52876bbffe71 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:15:48.750959 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba7b19ac-ad4f-4042-a2af-f03a790c2b70] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49012. Apr 19 04:15:48.768743 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-794d7f01-3d2b-4fe3-bec0-52876bbffe71 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] HTTP exception thrown: Instance 8953516a-dcec-4e76-92a9-9a8f25e24014 could not be found. Apr 19 04:15:48.769410 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-794d7f01-3d2b-4fe3-bec0-52876bbffe71 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Returning 404 to user: Instance 8953516a-dcec-4e76-92a9-9a8f25e24014 could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 04:15:48.770304 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-794d7f01-3d2b-4fe3-bec0-52876bbffe71 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 404 len: 111 microversion: 2.1 time: 0.081743 Apr 19 04:15:48.770885 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 897/1745] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 04:15:48 2021] DELETE /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 04:15:48.779703 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7aabec0-cf8a-4aa1-a76c-124920355490 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:15:48.780374 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b7aabec0-cf8a-4aa1-a76c-124920355490 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] [instance: 8953516a-dcec-4e76-92a9-9a8f25e24014] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:15:48.799649 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7aabec0-cf8a-4aa1-a76c-124920355490 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:15:48.800812 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7aabec0-cf8a-4aa1-a76c-124920355490 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:15:48.801645 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7aabec0-cf8a-4aa1-a76c-124920355490 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:15:48.802136 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b7aabec0-cf8a-4aa1-a76c-124920355490 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:15:48.857262 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] [6f4fc3c1-973c-4af6-b3e3-6cbadbf95d25] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49016. Apr 19 04:15:48.859184 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-b7aabec0-cf8a-4aa1-a76c-124920355490 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] HTTP exception thrown: Instance 8953516a-dcec-4e76-92a9-9a8f25e24014 could not be found. Apr 19 04:15:48.859859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b7aabec0-cf8a-4aa1-a76c-124920355490 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] Returning 404 to user: Instance 8953516a-dcec-4e76-92a9-9a8f25e24014 could not be found. {{(pid=100590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 04:15:48.860756 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b7aabec0-cf8a-4aa1-a76c-124920355490 tempest-AttachVolumeTestJSON-255679042 tempest-AttachVolumeTestJSON-255679042-project] 10.222.0.25 "GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014" status: 404 len: 111 microversion: 2.1 time: 0.085366 Apr 19 04:15:48.861344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 849/1746] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:15:48 2021] GET /compute/v2.1/servers/8953516a-dcec-4e76-92a9-9a8f25e24014 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 04:16:10.028674 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-35143396", "imageRef": "76911d44-3a4f-4574-9e95-24a6bb92880d", "flavorRef": "452"}} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 04:16:10.360609 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.network.neutron [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] validate_networks() for None {{(pid=100591) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 19 04:16:10.644523 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Flavor limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 04:16:10.644997 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Image limits 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 19 04:16:10.645538 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Flavor pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 04:16:10.645999 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Image pref 0:0:0 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 19 04:16:10.646458 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.virt.hardware [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 19 04:16:10.655416 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:10.655926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:10.656799 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:10.657292 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:10.675973 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Getting quotas for project 39aaf8ac8bf545a78a7c5de690cd0ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 19 04:16:10.680215 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.quota [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Getting quotas for user a71a03bbf61d489f88f8e92386ac36db and project 39aaf8ac8bf545a78a7c5de690cd0ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=100591) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 19 04:16:10.691454 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Going to run 1 instances... {{(pid=100591) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 19 04:16:10.694005 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='76911d44-3a4f-4574-9e95-24a6bb92880d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 19 04:16:10.768265 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [e9fd69f8-ef62-42a6-a857-2ec7dc327147] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 19 04:16:11.784986 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [e9fd69f8-ef62-42a6-a857-2ec7dc327147] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49550. Apr 19 04:16:11.789670 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-9096307f-efc1-4c7b-93d1-d8f21f72f4f2 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.765243 Apr 19 04:16:11.795575 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 898/1747] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Apr 19 04:16:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 19 04:16:11.801539 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7d17b33f-cc70-4dcd-8584-a647c4e23486 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:11.802208 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7d17b33f-cc70-4dcd-8584-a647c4e23486 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:12.059601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7d17b33f-cc70-4dcd-8584-a647c4e23486 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:12.067765 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7d17b33f-cc70-4dcd-8584-a647c4e23486 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1213 microversion: 2.1 time: 0.270862 Apr 19 04:16:12.068373 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 850/1748] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:11 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1213 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:13.085963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-17fde9c6-2d24-4dfe-8989-5a4bccdc8411 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:13.086631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-17fde9c6-2d24-4dfe-8989-5a4bccdc8411 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:13.164486 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-17fde9c6-2d24-4dfe-8989-5a4bccdc8411 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:13.172824 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-17fde9c6-2d24-4dfe-8989-5a4bccdc8411 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1213 microversion: 2.1 time: 0.090869 Apr 19 04:16:13.173395 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 899/1749] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:13 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:14.191443 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5f170b9a-3506-4b52-833b-0a11d6b97df6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:14.192109 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5f170b9a-3506-4b52-833b-0a11d6b97df6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:14.273336 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5f170b9a-3506-4b52-833b-0a11d6b97df6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:14.282329 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5f170b9a-3506-4b52-833b-0a11d6b97df6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1213 microversion: 2.1 time: 0.095445 Apr 19 04:16:14.283190 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 851/1750] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:14 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:15.300752 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-6122a7a2-cd13-46c2-8bc8-64149da4a330 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:15.301344 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-6122a7a2-cd13-46c2-8bc8-64149da4a330 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:15.382530 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-6122a7a2-cd13-46c2-8bc8-64149da4a330 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:15.390715 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-6122a7a2-cd13-46c2-8bc8-64149da4a330 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1213 microversion: 2.1 time: 0.094134 Apr 19 04:16:15.391445 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 900/1751] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:15 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:16.410011 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-947f26f0-1bb0-4dd1-9289-d39b1dd28bef tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:16.410776 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-947f26f0-1bb0-4dd1-9289-d39b1dd28bef tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:16.418650 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-947f26f0-1bb0-4dd1-9289-d39b1dd28bef tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:16.419213 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-947f26f0-1bb0-4dd1-9289-d39b1dd28bef tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:16.420038 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-947f26f0-1bb0-4dd1-9289-d39b1dd28bef tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:16.420536 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-947f26f0-1bb0-4dd1-9289-d39b1dd28bef tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:16.568610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-947f26f0-1bb0-4dd1-9289-d39b1dd28bef tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:16.568610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-947f26f0-1bb0-4dd1-9289-d39b1dd28bef tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1217 microversion: 2.1 time: 0.150748 Apr 19 04:16:16.568610 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 852/1752] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:16 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:17.574035 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-20c3019c-7192-427f-9fb0-1126105d2e88 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:17.574693 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-20c3019c-7192-427f-9fb0-1126105d2e88 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:17.584101 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20c3019c-7192-427f-9fb0-1126105d2e88 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:17.584859 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20c3019c-7192-427f-9fb0-1126105d2e88 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:17.585981 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20c3019c-7192-427f-9fb0-1126105d2e88 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:17.586676 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-20c3019c-7192-427f-9fb0-1126105d2e88 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:17.716563 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-20c3019c-7192-427f-9fb0-1126105d2e88 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:17.726631 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-20c3019c-7192-427f-9fb0-1126105d2e88 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1265 microversion: 2.1 time: 0.155985 Apr 19 04:16:17.727485 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 901/1753] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:17 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:18.746302 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-ece174b2-29c2-4043-a04e-2377a0847e7d tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:18.747982 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-ece174b2-29c2-4043-a04e-2377a0847e7d tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:18.758334 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ece174b2-29c2-4043-a04e-2377a0847e7d tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:18.758843 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ece174b2-29c2-4043-a04e-2377a0847e7d tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:18.759727 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ece174b2-29c2-4043-a04e-2377a0847e7d tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:18.760214 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-ece174b2-29c2-4043-a04e-2377a0847e7d tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:18.895772 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-ece174b2-29c2-4043-a04e-2377a0847e7d tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:18.904797 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-ece174b2-29c2-4043-a04e-2377a0847e7d tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1271 microversion: 2.1 time: 0.163117 Apr 19 04:16:18.905591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 853/1754] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:18 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:19.924440 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5de39305-a5d8-4c99-9a8c-f38f1cb66b40 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:19.925894 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5de39305-a5d8-4c99-9a8c-f38f1cb66b40 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:19.934656 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5de39305-a5d8-4c99-9a8c-f38f1cb66b40 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:19.935261 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5de39305-a5d8-4c99-9a8c-f38f1cb66b40 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:19.936227 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5de39305-a5d8-4c99-9a8c-f38f1cb66b40 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:19.936768 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5de39305-a5d8-4c99-9a8c-f38f1cb66b40 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:20.498232 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5de39305-a5d8-4c99-9a8c-f38f1cb66b40 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:20.508148 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5de39305-a5d8-4c99-9a8c-f38f1cb66b40 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1313 microversion: 2.1 time: 0.588828 Apr 19 04:16:20.508775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 902/1755] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:19 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:20.893896 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-19542cc3-b38c-4b33-9066-546d6ea2faaa req-110fa2e3-67d5-4ffe-b1e5-34c88dbb54c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e7f8711-adf3-4f11-8579-098f5f3740ae", "tag": "1bd9129d-a6b2-47fd-8ec5-e5588b764d83"}]} {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 04:16:20.898182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 04:16:20.898182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 04:16:20.904584 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-19542cc3-b38c-4b33-9066-546d6ea2faaa req-110fa2e3-67d5-4ffe-b1e5-34c88dbb54c8 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:20.905083 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-19542cc3-b38c-4b33-9066-546d6ea2faaa req-110fa2e3-67d5-4ffe-b1e5-34c88dbb54c8 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:20.922972 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-19542cc3-b38c-4b33-9066-546d6ea2faaa req-110fa2e3-67d5-4ffe-b1e5-34c88dbb54c8 service nova] Creating event network-changed:1bd9129d-a6b2-47fd-8ec5-e5588b764d83 for instance 6e7f8711-adf3-4f11-8579-098f5f3740ae on hv-cinder-78605 Apr 19 04:16:20.929777 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-19542cc3-b38c-4b33-9066-546d6ea2faaa req-110fa2e3-67d5-4ffe-b1e5-34c88dbb54c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226267 Apr 19 04:16:20.930417 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 854/1756] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 04:16:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 04:16:21.526381 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-7bf8c7e6-886f-457e-ba23-377bc7f018de tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:21.527046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-7bf8c7e6-886f-457e-ba23-377bc7f018de tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:21.535995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf8c7e6-886f-457e-ba23-377bc7f018de tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:21.535995 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf8c7e6-886f-457e-ba23-377bc7f018de tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:21.536804 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf8c7e6-886f-457e-ba23-377bc7f018de tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:21.537296 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-7bf8c7e6-886f-457e-ba23-377bc7f018de tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:21.943040 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-7bf8c7e6-886f-457e-ba23-377bc7f018de tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:21.952095 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-7bf8c7e6-886f-457e-ba23-377bc7f018de tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1313 microversion: 2.1 time: 0.430063 Apr 19 04:16:21.952716 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 903/1757] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:21 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:22.971120 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-bfdaa570-484f-4d37-9623-34c5b5f6515c tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:22.972484 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-bfdaa570-484f-4d37-9623-34c5b5f6515c tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:22.980450 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfdaa570-484f-4d37-9623-34c5b5f6515c tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:22.980950 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfdaa570-484f-4d37-9623-34c5b5f6515c tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:22.981771 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfdaa570-484f-4d37-9623-34c5b5f6515c tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:22.982259 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-bfdaa570-484f-4d37-9623-34c5b5f6515c tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:23.195212 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-bfdaa570-484f-4d37-9623-34c5b5f6515c tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:23.203946 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-bfdaa570-484f-4d37-9623-34c5b5f6515c tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1313 microversion: 2.1 time: 0.237469 Apr 19 04:16:23.204561 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 855/1758] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:22 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 04:16:24.222349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-b2d06465-3169-49e3-9a6f-a4ed7b6d22e6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:24.223031 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-b2d06465-3169-49e3-9a6f-a4ed7b6d22e6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:24.230963 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2d06465-3169-49e3-9a6f-a4ed7b6d22e6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:24.231506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2d06465-3169-49e3-9a6f-a4ed7b6d22e6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:24.232343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2d06465-3169-49e3-9a6f-a4ed7b6d22e6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:24.232872 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-b2d06465-3169-49e3-9a6f-a4ed7b6d22e6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:24.456926 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-b2d06465-3169-49e3-9a6f-a4ed7b6d22e6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:24.466279 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-b2d06465-3169-49e3-9a6f-a4ed7b6d22e6 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1313 microversion: 2.1 time: 0.248093 Apr 19 04:16:24.466907 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 904/1759] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:24 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:25.483505 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-89a31bcb-3768-42c3-880a-391a0811f964 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:25.484181 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-89a31bcb-3768-42c3-880a-391a0811f964 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:25.492306 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89a31bcb-3768-42c3-880a-391a0811f964 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:25.492825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89a31bcb-3768-42c3-880a-391a0811f964 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:25.493664 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89a31bcb-3768-42c3-880a-391a0811f964 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:25.494161 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-89a31bcb-3768-42c3-880a-391a0811f964 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:25.711354 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-89a31bcb-3768-42c3-880a-391a0811f964 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:25.720203 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-89a31bcb-3768-42c3-880a-391a0811f964 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1313 microversion: 2.1 time: 0.240833 Apr 19 04:16:25.720817 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 856/1760] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:25 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:26.214155 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-75876648-8134-421b-a726-b1900a127288 req-e536245f-a4bf-40ee-8891-bbdfb4cb53e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7f8711-adf3-4f11-8579-098f5f3740ae", "name": "network-vif-plugged", "status": "completed", "tag": "1bd9129d-a6b2-47fd-8ec5-e5588b764d83"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 04:16:26.216198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 04:16:26.216198 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 04:16:26.225853 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-75876648-8134-421b-a726-b1900a127288 req-e536245f-a4bf-40ee-8891-bbdfb4cb53e7 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:26.226349 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-75876648-8134-421b-a726-b1900a127288 req-e536245f-a4bf-40ee-8891-bbdfb4cb53e7 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:26.244616 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-75876648-8134-421b-a726-b1900a127288 req-e536245f-a4bf-40ee-8891-bbdfb4cb53e7 service nova] Creating event network-vif-plugged:1bd9129d-a6b2-47fd-8ec5-e5588b764d83 for instance 6e7f8711-adf3-4f11-8579-098f5f3740ae on hv-cinder-78605 Apr 19 04:16:26.250925 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-75876648-8134-421b-a726-b1900a127288 req-e536245f-a4bf-40ee-8891-bbdfb4cb53e7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099381 Apr 19 04:16:26.251914 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 905/1761] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 04:16:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 04:16:26.738008 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5ad3d42a-93c2-4b49-92bd-53a854f8f811 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:26.738775 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5ad3d42a-93c2-4b49-92bd-53a854f8f811 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:26.746740 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ad3d42a-93c2-4b49-92bd-53a854f8f811 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:26.747275 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ad3d42a-93c2-4b49-92bd-53a854f8f811 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:26.748105 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ad3d42a-93c2-4b49-92bd-53a854f8f811 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:26.748591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5ad3d42a-93c2-4b49-92bd-53a854f8f811 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:26.912041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:16:26.912041 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:16:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae (ip 10.222.0.25) !!! Apr 19 04:16:26.974533 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5ad3d42a-93c2-4b49-92bd-53a854f8f811 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:26.983475 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5ad3d42a-93c2-4b49-92bd-53a854f8f811 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1313 microversion: 2.1 time: 0.249449 Apr 19 04:16:26.984102 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 857/1762] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:26 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:27.224333 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:16:27.224487 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:16:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:16:28.002818 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-5cd609bf-1a9a-4f2c-b019-dea6be98f64a tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:28.003627 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-5cd609bf-1a9a-4f2c-b019-dea6be98f64a tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:28.012007 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cd609bf-1a9a-4f2c-b019-dea6be98f64a tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:28.012516 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cd609bf-1a9a-4f2c-b019-dea6be98f64a tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:28.013343 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cd609bf-1a9a-4f2c-b019-dea6be98f64a tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:28.013836 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-5cd609bf-1a9a-4f2c-b019-dea6be98f64a tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:28.228506 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-5cd609bf-1a9a-4f2c-b019-dea6be98f64a tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:28.237502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-5cd609bf-1a9a-4f2c-b019-dea6be98f64a tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1463 microversion: 2.1 time: 0.239356 Apr 19 04:16:28.238270 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 906/1763] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:27 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1463 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:28.310114 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-61eab46a-caca-44f2-b4e4-871ee4e49e89 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:28.310660 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-61eab46a-caca-44f2-b4e4-871ee4e49e89 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:28.318979 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-61eab46a-caca-44f2-b4e4-871ee4e49e89 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:28.319545 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-61eab46a-caca-44f2-b4e4-871ee4e49e89 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:28.320368 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-61eab46a-caca-44f2-b4e4-871ee4e49e89 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:28.320852 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-61eab46a-caca-44f2-b4e4-871ee4e49e89 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:28.388502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-61eab46a-caca-44f2-b4e4-871ee4e49e89 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Going to try to terminate instance {{(pid=100590) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 19 04:16:28.616199 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-61eab46a-caca-44f2-b4e4-871ee4e49e89 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 204 len: 0 microversion: 2.1 time: 0.309760 Apr 19 04:16:28.616888 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 858/1764] 10.222.0.25 () {58 vars in 1229 bytes} [Mon Apr 19 04:16:28 2021] DELETE /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 04:16:28.625601 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-def02c75-d3aa-47c1-b267-698326d162f3 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:28.626272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-def02c75-d3aa-47c1-b267-698326d162f3 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:28.634960 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-def02c75-d3aa-47c1-b267-698326d162f3 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:28.635501 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-def02c75-d3aa-47c1-b267-698326d162f3 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:28.636337 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-def02c75-d3aa-47c1-b267-698326d162f3 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:28.636825 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-def02c75-d3aa-47c1-b267-698326d162f3 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:28.851264 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-def02c75-d3aa-47c1-b267-698326d162f3 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100591) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:28.860182 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-def02c75-d3aa-47c1-b267-698326d162f3 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1469 microversion: 2.1 time: 0.238648 Apr 19 04:16:28.860808 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 907/1765] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:28 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:29.880815 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-e3a80d69-ee06-4721-849e-074d92f44386 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:29.881591 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-e3a80d69-ee06-4721-849e-074d92f44386 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:29.889633 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3a80d69-ee06-4721-849e-074d92f44386 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:29.890084 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3a80d69-ee06-4721-849e-074d92f44386 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:29.890915 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3a80d69-ee06-4721-849e-074d92f44386 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:29.891433 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-e3a80d69-ee06-4721-849e-074d92f44386 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:30.366267 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-e3a80d69-ee06-4721-849e-074d92f44386 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:30.375431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-e3a80d69-ee06-4721-849e-074d92f44386 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1469 microversion: 2.1 time: 0.499694 Apr 19 04:16:30.376058 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 859/1766] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:29 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1469 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:31.282729 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [req-e3138f03-16f2-4fd4-b9e1-457bd4e54b38 req-e0e03370-8d8d-4f5b-a6c3-58edfbfab8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e7f8711-adf3-4f11-8579-098f5f3740ae", "name": "network-vif-deleted", "tag": "1bd9129d-a6b2-47fd-8ec5-e5588b764d83"}]} {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 04:16:31.284862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 19 04:16:31.284862 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: warnings.warn(msg) Apr 19 04:16:31.294437 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e3138f03-16f2-4fd4-b9e1-457bd4e54b38 req-e0e03370-8d8d-4f5b-a6c3-58edfbfab8e1 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:31.295046 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [req-e3138f03-16f2-4fd4-b9e1-457bd4e54b38 req-e0e03370-8d8d-4f5b-a6c3-58edfbfab8e1 service nova] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:31.313590 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.compute.server_external_events [req-e3138f03-16f2-4fd4-b9e1-457bd4e54b38 req-e0e03370-8d8d-4f5b-a6c3-58edfbfab8e1 service nova] Creating event network-vif-deleted:1bd9129d-a6b2-47fd-8ec5-e5588b764d83 for instance 6e7f8711-adf3-4f11-8579-098f5f3740ae on hv-cinder-78605 Apr 19 04:16:31.320066 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [req-e3138f03-16f2-4fd4-b9e1-457bd4e54b38 req-e0e03370-8d8d-4f5b-a6c3-58edfbfab8e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041938 Apr 19 04:16:31.320830 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 908/1767] 10.222.0.25 () {64 vars in 1308 bytes} [Mon Apr 19 04:16:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 04:16:31.395809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-2cfba58b-75b3-4a0b-944c-037ccd198398 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:31.396406 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-2cfba58b-75b3-4a0b-944c-037ccd198398 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100590) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:31.404975 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cfba58b-75b3-4a0b-944c-037ccd198398 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:31.405483 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cfba58b-75b3-4a0b-944c-037ccd198398 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:31.406320 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cfba58b-75b3-4a0b-944c-037ccd198398 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:31.406813 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-2cfba58b-75b3-4a0b-944c-037ccd198398 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100590) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:31.558044 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.policy [None req-2cfba58b-75b3-4a0b-944c-037ccd198398 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a71a03bbf61d489f88f8e92386ac36db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39aaf8ac8bf545a78a7c5de690cd0ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100590) authorize /opt/stack/nova/nova/policy.py:202}} Apr 19 04:16:31.567978 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-2cfba58b-75b3-4a0b-944c-037ccd198398 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 200 len: 1298 microversion: 2.1 time: 0.177804 Apr 19 04:16:31.569502 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100590|app: 0|req: 860/1768] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:31 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 1298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 04:16:32.588272 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-19eee9b9-098e-4851-9b30-3247b38a5558 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Calling method '>' {{(pid=100591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 19 04:16:32.589281 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.compute.api [None req-19eee9b9-098e-4851-9b30-3247b38a5558 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] [instance: 6e7f8711-adf3-4f11-8579-098f5f3740ae] Fetching instance by UUID {{(pid=100591) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 19 04:16:32.598131 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19eee9b9-098e-4851-9b30-3247b38a5558 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:32.598637 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19eee9b9-098e-4851-9b30-3247b38a5558 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:32.599582 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19eee9b9-098e-4851-9b30-3247b38a5558 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 19 04:16:32.600048 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG oslo_concurrency.lockutils [None req-19eee9b9-098e-4851-9b30-3247b38a5558 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Lock "d1a8657f-9eb9-42f5-92ff-db32cbe2d1fb" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100591) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 19 04:16:32.657257 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.wsgi [None req-19eee9b9-098e-4851-9b30-3247b38a5558 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] HTTP exception thrown: Instance 6e7f8711-adf3-4f11-8579-098f5f3740ae could not be found. Apr 19 04:16:32.657936 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: DEBUG nova.api.openstack.wsgi [None req-19eee9b9-098e-4851-9b30-3247b38a5558 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] Returning 404 to user: Instance 6e7f8711-adf3-4f11-8579-098f5f3740ae could not be found. {{(pid=100591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 19 04:16:32.659623 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO nova.api.openstack.requestlog [None req-19eee9b9-098e-4851-9b30-3247b38a5558 tempest-VolumesNegativeTest-1629332382 tempest-VolumesNegativeTest-1629332382-project] 10.222.0.25 "GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae" status: 404 len: 111 microversion: 2.1 time: 0.076156 Apr 19 04:16:32.660431 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: [pid: 100591|app: 0|req: 909/1769] 10.222.0.25 () {58 vars in 1226 bytes} [Mon Apr 19 04:16:32 2021] GET /compute/v2.1/servers/6e7f8711-adf3-4f11-8579-098f5f3740ae => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 04:18:23.330876 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:18:23.331464 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:18:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:19:46.934800 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:19:46.935393 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:19:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:19:47.240904 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:19:47.241056 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:19:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:21:28.178571 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:21:28.179122 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:21:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:21:43.347809 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:21:43.348327 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:21:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 19 04:21:46.528534 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 04:21:46.529059 dv-cinder-786054-3-iscsi devstack@n-api.service[100588]: Mon Apr 19 04:21:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!